00000001:02000400:0.0F:1783071195.158461:0:2946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783071213.225282:0:3169:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783071215.024234:0:3230:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 597 MB/s 00000001:01000000:3.0:1783071215.273939:0:3230:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 943 MB/s 00000001:01000000:3.0:1783071215.524607:0:3230:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4775 MB/s 00000020:02000000:2.0:1783071216.418976:0:3261:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g8e46928 00000400:02000000:3.0:1783071217.219404:0:3276:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.116@tcp [8/256/0/180] 00008000:02000000:1.0F:1783071220.518333:0:3426:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783071261.991668:0:5231:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783071268.952899:0:5771:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783071268.952905:0:5771:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1783071268.953042:0:5771:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000eff50272 00000080:02000400:1.0:1783071268.953053:0:5771:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783071268.962565:0:5771:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783071268.962591:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783071268.962636:0:5771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007665c36a) 00000020:00000080:0.0:1783071268.962789:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783071268.987128:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783071268.987665:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783071269.014977:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783071269.015007:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783071269.015027:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783071269.015075:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783071269.015098:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783071269.015430:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783071269.015438:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783071269.015449:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec6e53 00000020:01000004:3.0:1783071269.015456:0:5771:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783071269.015461:0:5771:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783071269.015465:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eff50272 from MGS 00000020:01000004:3.0:1783071269.015469:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783071269.015485:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000da0bf66a) 00000020:00000080:3.0:1783071269.015496:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783071269.015598:0:5771:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eff50272 from MGS, refs=2 00080000:01000000:3.0:1783071269.015604:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783071269.015609:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec6e61 00000100:00100000:3.0:1783071269.015779:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783071269.015899:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783071269.015904:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783071269.016323:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783071269.016330:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783071269.017101:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071269.017228:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783071269.017232:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783071269.017740:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783071269.017750:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783071269.018130:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783071269.018134:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783071269.018852:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071269.018855:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071269.018857:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071269.019120:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071269.019122:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071269.019124:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071269.019839:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783071269.024487:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783071269.269654:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3823 MB/s 00000001:01000000:0.0:1783071269.520496:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3398 MB/s 00000001:01000000:3.0:1783071269.770012:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 647 MB/s 00000001:01000000:3.0:1783071270.020127:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1243 MB/s 00080000:10000000:3.0:1783071270.027594:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1783071270.046083:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783071270.046095:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783071270.046097:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1783071270.049178:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783071270.049996:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783071270.050216:0:5771:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783071270.050265:0:5771:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783071270.050527:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783071270.050555:0:5771:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783071270.052010:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071270.052179:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783071270.052186:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783071270.055516:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783071270.055529:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783071270.056442:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783071270.056451:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783071270.063287:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783071270.063307:0:5771:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:2.0:1783071270.063309:0:5771:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783071270.063353:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:2.0:1783071270.063368:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (0000000067d1750a) 00000020:00000080:2.0:1783071270.063384:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783071270.063506:0:5771:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4950b2e@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071270.063669:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:2.0:1783071270.063706:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783071270.065699:0:5787:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783071270.067256:0:5788:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783071270.071440:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 68e3cd25-c67d-4a78-96d1-ad55e0a83e15) 00000020:00000080:2.0:1783071270.071464:0:5771:0:(genops.c:1406:class_connect()) connect: client 68e3cd25-c67d-4a78-96d1-ad55e0a83e15, cookie 0xd360fc6ce6ec6e6f 00000100:00080000:2.0:1783071270.071476:0:5771:0:(import.c:512:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071270.071482:0:5771:0:(import.c:626:import_select_connection()) MGC192.168.202.116@tcp: import 00000000e4950b2e using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1783071270.071528:0:5771:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000062de158e x1869685684437120/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071270.071552:0:5771:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS 00000020:01000004:2.0:1783071270.071585:0:5771:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783071270.071590:0:5771:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783071270.071602:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004578a0e6) 00000020:00000080:2.0:1783071270.071614:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783071270.074226:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062de158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684437120:0@lo:250: 00000100:00100000:3.0:1783071270.074299:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071270.074421:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437120 00000100:00100000:0.0:1783071270.074430:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437120 00000100:00100000:0.0:1783071270.074461:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071270.074469:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a21125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1869685684437120:12345-0@lo:250: 00010000:00080000:0.0:1783071270.074495:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 68e3cd25-c67d-4a78-96d1-ad55e0a83e15@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1783071270.074551:0:5783:0:(genops.c:1406:class_connect()) connect: client 68e3cd25-c67d-4a78-96d1-ad55e0a83e15, cookie 0xd360fc6ce6ec6e7d 00000100:00080000:0.0:1783071270.074732:0:5783:0:(import.c:65:import_set_state_nolock()) 000000002c0c6e80 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071270.075065:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a21125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:3291:x1869685684437120:12345-0@lo:250: Request processed in 594us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.075073:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071270.076164:0:3291:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783071270.076177:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:3.0:1783071270.076185:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783071270.076205:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783071270.076209:0:3291:0:(import.c:65:import_set_state_nolock()) 00000000e4950b2e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783071270.076213:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783071270.076221:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783071270.076227:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062de158e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684437120:0@lo:250: 00000100:00100000:3.0:1783071270.090093:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071270.090445:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071270.090453:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783071270.091893:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071270.091903:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783071270.092422:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783071270.092428:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783071270.093395:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071270.093633:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783071270.093638:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783071270.094158:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783071270.094165:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783071270.123976:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071270.124154:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783071270.124161:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783071270.126024:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783071270.126037:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783071270.126873:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071270.127036:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783071270.127042:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783071270.127481:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783071270.127487:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783071270.130141:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071270.130654:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783071270.130661:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783071270.131377:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783071270.131385:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783071270.132245:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071270.132398:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783071270.132403:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783071270.133029:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783071270.133034:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783071270.151339:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071270.151557:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071270.151578:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783071270.153601:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071270.153616:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783071270.154980:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783071270.154998:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783071270.155909:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783071270.155933:0:5771:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783071270.155939:0:5771:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783071270.156063:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783071270.156097:0:5771:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783071270.156102:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783071270.156103:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.156105:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.156106:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071270.156107:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.156108:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.156109:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.156111:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.156113:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071270.156115:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071270.156116:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.156122:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071270.156125:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783071270.156127:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071270.156128:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.156129:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.156130:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071270.156131:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.156132:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.156133:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.156134:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.156135:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071270.156135:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071270.156136:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.156137:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071270.156174:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783071270.156190:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437248:0@lo:253: 00000100:00100000:2.0:1783071270.156278:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.156366:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023b235c2 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.156413:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437248 00000100:00100000:0.0:1783071270.156422:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437248 00000100:00100000:0.0:1783071270.156504:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071270.156513:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bc59860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5771:x1869685684437248:12345-0@lo:253: 20000000:01000000:0.0:1783071270.156569:0:5785:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783071270.156572:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783071270.156985:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783071270.157037:0:5785:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783071270.157370:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071270.158341:0:5808:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783071270.158661:0:5785:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783071270.158665:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783071270.158843:0:5785:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783071270.158853:0:5785:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783071270.158870:0:5785:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783071270.159074:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071270.159242:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783071270.159252:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783071270.159305:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783071270.159356:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1783071270.159395:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1783071270.159482:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1783071270.159491:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1783071270.159535:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1783071270.159542:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1783071270.159582:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1783071270.159590:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1783071270.159628:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1783071270.159668:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1783071270.159953:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783071270.159958:0:5785:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1783071270.159968:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071270.160126:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1783071270.160135:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783071270.160163:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1783071270.160189:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1783071270.160231:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1783071270.160242:0:5785:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1783071270.160314:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1783071270.160323:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783071270.160368:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1783071270.160407:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1783071270.160442:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1783071270.160453:0:5785:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1783071270.160532:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1783071270.160548:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1783071270.160595:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1783071270.160627:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1783071270.161003:0:5785:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1783071270.161052:0:5785:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783071270.161059:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1783071270.161417:0:5809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783071270.162309:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783071270.162334:0:5785:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.116@tcp for mdt 20000000:01000000:1.0:1783071270.162335:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:1.0:1783071270.162353:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783071270.162358:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783071270.162378:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783071270.162386:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:1.0:1783071270.162429:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783071270.162441:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783071270.162474:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783071270.162509:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783071270.162550:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783071270.162553:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783071270.162557:0:5785:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783071270.162574:0:5785:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783071270.163037:0:5810:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1783071270.163174:0:5785:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1783071270.172735:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1783071270.173414:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1783071270.173525:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1783071270.173545:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783071270.173547:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783071270.173551:0:5785:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783071270.173586:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783071270.173589:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783071270.173618:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783071270.173620:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783071270.175221:0:5811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1783071270.175863:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1783071270.175915:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1783071270.175983:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1783071270.175997:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783071270.175999:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783071270.177363:0:5812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783071270.177901:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783071270.177964:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783071270.178001:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1783071270.178014:0:5785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071270.178016:0:5785:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1783071270.178022:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783071270.178041:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178058:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178067:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178072:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178078:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178084:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178089:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b2eca35 already unused, calling callback (000000008ece4b5b) 00010000:00010000:2.0:1783071270.178093:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178099:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178109:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178125:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.178130:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6e84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071270.178598:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783071270.391946:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bc59860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5771:x1869685684437248:12345-0@lo:253: Request processed in 235427us (235662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.391961:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071270.392067:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437248:0@lo:253: 10000000:01000000:2.0:1783071270.392080:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783071270.392084:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071270.392086:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.392087:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.392088:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783071270.392090:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.392091:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.392092:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.392094:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.392095:0:5771:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783071270.392097:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.392098:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783071270.392120:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eff50272 from lustre-MDT0000 10000000:01000000:2.0:1783071270.392146:0:5771:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783071270.392148:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783071270.392152:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9782c5bbb380 10000000:01000000:2.0:1783071270.392157:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071270.392165:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9782c5bbb380 from 1 10000000:01000000:2.0:1783071270.392167:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071270.392202:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.392212:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.392238:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071270.392257:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437376:0@lo:101: 00000100:00100000:2.0:1783071270.392290:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.392367:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.392452:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437376 00000100:00100000:0.0:1783071270.392458:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437376 00000100:00100000:0.0:1783071270.392492:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071270.392500:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009afb8230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5771:x1869685684437376:12345-0@lo:101: 00010000:00010000:0.0:1783071270.392513:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071270.392525:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6e8b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.392545:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.392554:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.392574:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a568e45f, rc 0) 00000100:00100000:0.0:1783071270.392603:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009afb8230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:5771:x1869685684437376:12345-0@lo:101: Request processed in 104us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.392609:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071270.392622:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437376:0@lo:101: 00010000:00010000:2.0:1783071270.392634:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.392643:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071270.392697:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437504:0@lo:501: 00000100:00100000:2.0:1783071270.392715:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.392734:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.392812:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437504 00000100:00100000:0.0:1783071270.392816:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437504 00000100:00100000:0.0:1783071270.392837:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071270.392849:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016bd869b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:5771:x1869685684437504:12345-0@lo:501: 00000100:00100000:0.0:1783071270.393054:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016bd869b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:5771:x1869685684437504:12345-0@lo:501: Request processed in 205us (338us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071270.393062:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071270.393131:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437504:0@lo:501: 10000000:01000000:2.0:1783071270.393147:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071270.393190:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393196:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071270.393200:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9782c8344000 10000000:01000000:2.0:1783071270.393203:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783071270.393209:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9782c8344000 10000000:01000000:2.0:1783071270.393211:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783071270.393213:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9782c8344000 from 1 10000000:01000000:2.0:1783071270.393214:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783071270.393224:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393229:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393233:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071270.393240:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437632:0@lo:101: 00000100:00100000:2.0:1783071270.393263:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.393283:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.393328:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437632 00000100:00100000:0.0:1783071270.393331:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437632 00000100:00100000:0.0:1783071270.393352:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071270.393362:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebd3a708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:5771:x1869685684437632:12345-0@lo:101: 00010000:00010000:0.0:1783071270.393369:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071270.393377:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047581a36/0xd360fc6ce6ec6ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6e99 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393391:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047581a36/0xd360fc6ce6ec6ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e99 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393398:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047581a36/0xd360fc6ce6ec6ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e99 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393404:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047581a36, rc 0) 00000100:00100000:0.0:1783071270.393436:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebd3a708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+7:5771:x1869685684437632:12345-0@lo:101: Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.393442:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071270.393459:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437632:0@lo:101: 00010000:00010000:2.0:1783071270.393469:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393475:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071270.393485:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783071270.393500:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393506:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000001e34f3d7/0xd360fc6ce6ec6e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071270.393522:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783071270.393525:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071270.393529:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9782c8344000 10000000:01000000:2.0:1783071270.393531:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783071270.393533:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783071270.393535:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071270.393545:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393549:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393553:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071270.393574:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437760:0@lo:101: 00000100:00100000:2.0:1783071270.393598:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.393620:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.393638:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437760 00000100:00100000:0.0:1783071270.393642:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437760 00000100:00100000:0.0:1783071270.393663:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071270.393668:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b9afec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+7:5771:x1869685684437760:12345-0@lo:101: 00010000:00010000:0.0:1783071270.393745:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071270.393818:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6ea7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393832:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393842:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.393846:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030306fa1, rc 0) 00000100:00100000:0.0:1783071270.393878:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b9afec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:5771:x1869685684437760:12345-0@lo:101: Request processed in 209us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.393884:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071270.393909:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437760:0@lo:101: 00010000:00010000:2.0:1783071270.393919:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.393925:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071270.393955:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437888:0@lo:501: 00000100:00100000:2.0:1783071270.394147:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.394174:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.394186:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684437888 00000100:00100000:0.0:1783071270.394191:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684437888 00000100:00100000:0.0:1783071270.394212:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071270.394217:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019aaf596 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:5771:x1869685684437888:12345-0@lo:501: 00000100:00100000:0.0:1783071270.394406:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019aaf596 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5771:x1869685684437888:12345-0@lo:501: Request processed in 188us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.394412:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071270.394505:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684437888:0@lo:501: 00000100:00100000:2.0:1783071270.394531:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438016:0@lo:503: 00000100:00100000:2.0:1783071270.394567:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.394588:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0afdec3 going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.394629:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438016 00000100:00100000:0.0:1783071270.394632:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438016 00000100:00100000:0.0:1783071270.394651:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071270.394654:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9dc7c24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5771:x1869685684438016:12345-0@lo:503: 00000100:00100000:0.0:1783071270.394855:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9dc7c24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5771:x1869685684438016:12345-0@lo:503: Request processed in 199us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.394866:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071270.394890:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438016:0@lo:503: 00000100:00100000:2.0:1783071270.395351:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5815:1869685684438144:0@lo:502: 00000100:00100000:2.0:1783071270.395378:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.395406:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set 000000002c19fd9a going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.395450:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438144 00000100:00100000:0.0:1783071270.395454:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438144 00000100:00100000:0.0:1783071270.395480:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071270.395492:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fe5d062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5815:x1869685684438144:12345-0@lo:502: 00000100:00100000:0.0:1783071270.395631:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fe5d062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5815:x1869685684438144:12345-0@lo:502: Request processed in 139us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.395638:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071270.395648:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5815:1869685684438144:0@lo:502: 00000020:01000000:2.0:1783071270.395666:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071270.395700:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071270.395703:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783071270.395709:0:5815:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783071270.395712:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071270.395823:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005631b2a9) 00000020:00000080:3.0:1783071270.395839:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783071270.395846:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783071270.395905:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783071270.395911:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec6ebc 00000020:00000080:3.0:1783071270.396127:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783071270.396130:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071270.396133:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071270.396134:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783071270.396136:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071270.396138:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071270.396139:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783071270.396140:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071270.396145:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a7fd3c0d) 00000020:00000080:3.0:1783071270.396152:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783071270.396154:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783071270.396155:0:5815:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783071270.396157:0:5815:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783071270.396165:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783071270.396195:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eff50272 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783071270.396202:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001f500e3a) 00000020:00000080:3.0:1783071270.396207:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783071270.396246:0:5815:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783071270.396251:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec6ed1 00000020:00000080:3.0:1783071270.396323:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783071270.396328:0:5815:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783071270.396331:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd360fc6ce6ec6ed8 00080000:01000000:3.0:1783071270.396333:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783071270.396335:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec6edf 00080000:10000000:3.0:1783071270.396633:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1783071270.396910:0:5815:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783071270.399614:0:5815:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783071270.454379:0:5815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783071270.454824:0:5815:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783071270.457289:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783071270.457547:0:5815:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783071270.480647:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001c3f1364) 00000020:00000080:2.0:1783071270.480665:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783071270.480727:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783071270.480731:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec6eed 00000020:00000080:2.0:1783071270.481237:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1783071270.482595:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071270.509570:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071270.533247:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.557916:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.594164:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.624914:0:5815:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1783071270.648076:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd360fc6ce6ec6ef4 00000020:00000080:2.0:1783071270.648616:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783071270.648628:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071270.648640:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071270.648643:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783071270.648647:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071270.648653:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071270.648654:0:5815:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783071270.648659:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783071270.648725:0:5815:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783071270.648743:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071270.648757:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071270.648759:0:5815:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783071270.648762:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071270.648764:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071270.648765:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071270.648768:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071270.648769:0:5815:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783071270.648813:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5815:1869685684438272:0@lo:502: 00000100:00100000:2.0:1783071270.648891:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.648992:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a502b5be going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.649341:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438272 00000100:00100000:0.0:1783071270.649349:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438272 00000100:00100000:0.0:1783071270.649429:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071270.649438:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e228e107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5815:x1869685684438272:12345-0@lo:502: 00000100:00100000:0.0:1783071270.649888:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e228e107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5815:x1869685684438272:12345-0@lo:502: Request processed in 451us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.649897:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783071270.649970:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000027c5e0fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5815:1869685684438272:0@lo:502: 00000020:01000000:3.0:1783071270.649996:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071270.650002:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071270.650003:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071270.650007:0:5815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783071270.650168:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783071270.650186:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783071270.650206:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.650216:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071270.650222:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9782c8344000 from 1 10000000:01000000:1.0:1783071270.650225:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783071270.650263:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.650270:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.650278:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.650291:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438400:0@lo:101: 00000100:00100000:1.0:1783071270.650322:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.650466:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce3cf23d going to sleep for 11 seconds 00000100:00100000:2.0:1783071270.650519:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438400 00000100:00100000:2.0:1783071270.650524:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438400 00000100:00100000:2.0:1783071270.650547:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071270.650553:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046c5c1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5771:x1869685684438400:12345-0@lo:101: 00010000:00010000:2.0:1783071270.650574:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071270.650587:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6efb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.650609:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.650618:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.650637:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ed8a899, rc 0) 00000100:00100000:2.0:1783071270.650773:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046c5c1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5771:x1869685684438400:12345-0@lo:101: Request processed in 220us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071270.650779:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071270.650885:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438400:0@lo:101: 00010000:00010000:1.0:1783071270.650903:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.650912:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.651415:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438528:0@lo:256: 00000100:00100000:1.0:1783071270.651460:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.651531:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce3cf23d going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.651594:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438528 00000100:00100000:0.0:1783071270.651599:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438528 00000100:00100000:2.0:1783071270.651641:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071270.651648:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c4d4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5771:x1869685684438528:12345-0@lo:256: 20000000:01000000:2.0:1783071270.651664:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783071270.651669:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783071270.652043:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c4d4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5771:x1869685684438528:12345-0@lo:256: Request processed in 395us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071270.652051:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071270.659030:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438528:0@lo:256: 10000000:01000000:1.0:1783071270.659630:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071270.659829:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.659841:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071270.659849:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c8344000 from 1 10000000:01000000:1.0:1783071270.659852:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071270.659890:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.659899:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.659907:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.659926:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438656:0@lo:101: 00000100:00100000:1.0:1783071270.659985:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.660110:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce3cf23d going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.660189:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438656 00000100:00100000:0.0:1783071270.660196:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438656 00000100:00100000:0.0:1783071270.660277:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071270.660285:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000578053e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5771:x1869685684438656:12345-0@lo:101: 00010000:00010000:0.0:1783071270.660298:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071270.660311:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f09 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.660335:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.660344:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.660352:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc94b2ad, rc 0) 00000100:00100000:0.0:1783071270.660394:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000578053e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684438656:12345-0@lo:101: Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.660414:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071270.660485:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438656:0@lo:101: 00010000:00010000:1.0:1783071270.660502:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.660509:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.660572:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438784:0@lo:501: 00000100:00100000:1.0:1783071270.660598:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.660696:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce3cf23d going to sleep for 11 seconds 00000100:00100000:2.0:1783071270.660905:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438784 00000100:00100000:2.0:1783071270.660910:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438784 00000100:00100000:2.0:1783071270.660931:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071270.660936:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6378178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684438784:12345-0@lo:501: 00000100:00100000:2.0:1783071270.661476:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6378178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684438784:12345-0@lo:501: Request processed in 539us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071270.661484:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071270.661627:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438784:0@lo:501: 00000100:00100000:1.0:1783071270.661664:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438912:0@lo:503: 00000100:00100000:1.0:1783071270.661838:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.661895:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce3cf23d going to sleep for 11 seconds 00000100:00100000:3.0:1783071270.661958:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684438912 00000100:00100000:3.0:1783071270.661963:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684438912 00000100:00100000:2.0:1783071270.662103:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071270.662110:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000806b6e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684438912:12345-0@lo:503: 00000040:00080000:2.0:1783071270.662148:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071270.662196:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000806b6e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684438912:12345-0@lo:503: Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071270.662202:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071270.662271:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684438912:0@lo:503: 00000040:00080000:1.0:1783071270.663049:0:5819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783071270.663217:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783071270.663231:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071270.663248:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.663256:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071270.663296:0:5771:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783071270.663298:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9782c8344000 10000000:01000000:3.0:1783071270.663300:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9782c8344000 10000000:01000000:3.0:1783071270.663303:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071270.663307:0:5771:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c8344000 from 1 10000000:01000000:3.0:1783071270.663308:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071270.663342:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.663347:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.663353:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071270.663366:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439040:0@lo:101: 00000100:00100000:3.0:1783071270.663403:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071270.664040:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000664fb78d going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.664136:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439040 00000100:00100000:0.0:1783071270.664142:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439040 00000100:00100000:0.0:1783071270.664174:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071270.664180:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb253396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684439040:12345-0@lo:101: 00010000:00010000:0.0:1783071270.664191:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071270.664203:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f17 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.664224:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.664234:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.664241:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000baee295b, rc 0) 00000100:00100000:0.0:1783071270.664288:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb253396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439040:12345-0@lo:101: Request processed in 108us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.664294:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071270.664382:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439040:0@lo:101: 00010000:00010000:3.0:1783071270.664394:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.664402:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071270.664449:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439168:0@lo:501: 00000100:00100000:3.0:1783071270.664474:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071270.664504:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000664fb78d going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.664606:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439168 00000100:00100000:0.0:1783071270.664610:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439168 00000100:00100000:0.0:1783071270.664628:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071270.664633:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acd03d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439168:12345-0@lo:501: 00000100:00100000:0.0:1783071270.664955:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acd03d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439168:12345-0@lo:501: Request processed in 322us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.664961:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071270.665163:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439168:0@lo:501: 00000100:00100000:3.0:1783071270.665190:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439296:0@lo:503: 00000100:00100000:3.0:1783071270.665225:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071270.665242:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000664fb78d going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.665288:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439296 00000100:00100000:0.0:1783071270.665292:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439296 00000100:00100000:0.0:1783071270.665316:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071270.665321:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d94284f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439296:12345-0@lo:503: 00000100:00100000:0.0:1783071270.665632:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d94284f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439296:12345-0@lo:503: Request processed in 310us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.665639:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783071270.665798:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439296:0@lo:503: 00000100:00100000:3.0:1783071270.666236:0:5820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5820:1869685684439424:0@lo:502: 00000100:00100000:3.0:1783071270.666284:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071270.666311:0:5820:0:(client.c:2701:ptlrpc_set_wait()) set 00000000696ec29c going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.666357:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439424 00000100:00100000:0.0:1783071270.666362:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439424 00000100:00100000:0.0:1783071270.666398:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071270.666405:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010c1f428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5820:x1869685684439424:12345-0@lo:502: 00000100:00100000:0.0:1783071270.666589:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010c1f428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5820:x1869685684439424:12345-0@lo:502: Request processed in 184us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.666595:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071270.666763:0:5820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5820:1869685684439424:0@lo:502: 00000020:01000004:3.0:1783071270.666803:0:5820:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783071270.666820:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000ba59bdc) 00000020:00000080:3.0:1783071270.666835:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783071270.666988:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eff50272 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071270.666991:0:5820:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eff50272 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783071270.666993:0:5820:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000eff50272 4 00010000:00080000:3.0:1783071270.667024:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000086de7e07@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1783071270.668285:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783071270.668346:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783071270.668372:0:5820:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783071270.668383:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd360fc6ce6ec6f2c 00000100:00080000:3.0:1783071270.668390:0:5820:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071270.668394:0:5820:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000086de7e07 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1783071270.668423:0:5820:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f758e1df x1869685684439552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071270.668455:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684439552:0@lo:38: 00000100:00100000:3.0:1783071270.668501:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071270.668553:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439552 00000100:00100000:3.0:1783071270.668571:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439552 00000100:00100000:3.0:1783071270.668600:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071270.668605:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000900ce6dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1869685684439552:12345-0@lo:38: 00000100:00100000:3.0:1783071270.668649:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000900ce6dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1869685684439552:12345-0@lo:38: Request processed in 43us (147us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783071270.668656:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071270.668716:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071270.668722:0:3291:0:(import.c:65:import_set_state_nolock()) 0000000086de7e07 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783071270.668735:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783071270.668739:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f758e1df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684439552:0@lo:38: 00000100:00080000:3.0:1783071270.668769:0:5820:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783071270.670920:0:5820:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5ade93e pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5820:1869685684439680:0@lo:502: 00000100:00100000:2.0:1783071270.670996:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.671033:0:5820:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d1ecd59a going to sleep for 11 seconds 00000100:00100000:0.0:1783071270.671079:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439680 00000100:00100000:0.0:1783071270.671086:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439680 00000100:00100000:0.0:1783071270.671130:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071270.671137:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024c68a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5820:x1869685684439680:12345-0@lo:502: 00000100:00100000:0.0:1783071270.671354:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024c68a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5820:x1869685684439680:12345-0@lo:502: Request processed in 217us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071270.671362:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071270.671483:0:5820:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5ade93e pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5820:1869685684439680:0@lo:502: 00000040:00080000:0.0:1783071270.671506:0:5820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783071270.671736:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783071270.671873:0:5771:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071270.671923:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071270.671934:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783071270.671978:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783071270.671980:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.671981:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.671982:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071270.671983:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.671985:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.671986:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.671987:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.671989:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071270.671990:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071270.671991:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.671993:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071270.671996:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783071270.671998:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071270.672000:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.672001:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.672002:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071270.672003:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.672004:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.672005:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.672006:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.672007:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071270.672008:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071270.672009:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.672009:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071270.672024:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783071270.672040:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f4260ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439808:0@lo:253: 00000100:00100000:2.0:1783071270.672071:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071270.672095:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set 00000000282dc83b going to sleep for 11 seconds 00000100:00100000:1.0:1783071270.672933:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439808 00000100:00100000:1.0:1783071270.672941:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439808 00000100:00100000:1.0:1783071270.673000:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071270.673006:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f279356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5771:x1869685684439808:12345-0@lo:253: 20000000:01000000:1.0:1783071270.673041:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071270.673055:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783071270.706123:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783071270.706140:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783071270.706184:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071270.706187:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071270.706203:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.706218:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.706238:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.706277:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071270.706287:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 12 pid: 5783 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071270.706299:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000631c3c5d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684439936:0@lo:104: 00000100:00100000:0.0:1783071270.706357:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071270.706420:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set 000000001fee5621 going to sleep for 11 seconds 00000100:00100000:1.0:1783071270.706608:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684439936 00000100:00100000:1.0:1783071270.706617:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684439936 00000100:00100000:1.0:1783071270.706666:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071270.706696:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db2a3ae6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684439936:12345-0@lo:104: 00010000:00010000:1.0:1783071270.706709:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706776:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071270.706782:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db2a3ae6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684439936:12345-0@lo:104: Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071270.706796:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783071270.706832:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071270.706838:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706846:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068043cdb already unused, calling callback (00000000becd8c43) 10000000:00010000:1.0:1783071270.706849:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706857:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071270.706864:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071270.706868:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071270.706895:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706901:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071270.706919:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706924:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 0000000068043cdb/0xd360fc6ce6ec6efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f02 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.706946:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071270.706948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071270.706949:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071270.707062:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684440064:0@lo:103: 00000100:00100000:1.0:1783071270.707095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071270.707175:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440064 00000100:00100000:1.0:1783071270.707180:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440064 00010000:00010000:1.0:1783071270.707196:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 13 pid: 5783 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.707218:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071270.707223:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024334810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3293:x1869685684440064:12345-0@lo:103: 00010000:00010000:1.0:1783071270.707233:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071270.707237:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 13 pid: 5783 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707245:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 13 pid: 5783 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707260:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707267:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783071270.707277:0:5775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001090937s 00010000:00010000:1.0:1783071270.707280:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707285:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707290:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707305:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707309:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1965fb4 already unused, calling callback (000000008ece4b5b) 00010000:00010000:1.0:1783071270.707312:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707318:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707325:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071270.707335:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071270.707362:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024334810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3293:x1869685684440064:12345-0@lo:103: Request processed in 139us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071270.707433:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071270.707468:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684440064:0@lo:103: 00010000:00010000:3.0:1783071270.707551:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ed8a899/0xd360fc6ce6ec6f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6efb expref: 12 pid: 5783 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071270.707574:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000631c3c5d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684439936:0@lo:104: 00010000:00010000:3.0:1783071270.707588:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.707595:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.707600:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071270.707605:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071270.716913:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f279356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5771:x1869685684439808:12345-0@lo:253: Request processed in 43899us (44832us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071270.716931:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071270.717020:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f4260ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5771:1869685684439808:0@lo:253: 10000000:01000000:2.0:1783071270.717034:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783071270.717037:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071270.717039:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783071270.717040:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071270.717041:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071270.717042:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071270.717043:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071270.717045:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783071270.717046:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783071270.717047:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071270.717048:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071270.717049:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071270.717050:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783071270.717067:0:5771:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783071270.722295:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.722811:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071270.722985:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.723116:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071270.723263:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.723473:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071270.724432:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.724643:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071270.724953:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.725127:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071270.725335:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071270.725603:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1783071270.760564:0:5771:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783071270.791582:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783071270.791589:0:5825:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1783071270.791593:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783071270.791945:0:5826:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783071270.794742:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783071270.794988:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783071270.795788:0:5771:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783071270.799565:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783071270.799859:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071270.800933:0:5771:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783071270.801465:0:5771:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783071270.801493:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783071270.801719:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783071270.801906:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1783071270.804217:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783071270.804355:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783071270.804692:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783071270.804931:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783071270.805072:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783071270.807082:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783071270.807342:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783071270.808646:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783071270.808883:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783071270.809083:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783071270.809261:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783071270.809399:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783071270.809581:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783071270.809756:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783071270.809877:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783071270.810027:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783071270.810295:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783071270.810441:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783071270.810572:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783071270.810755:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783071270.810887:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783071270.811003:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783071270.811128:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783071270.811270:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783071270.811387:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783071270.811504:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783071270.811634:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783071270.811822:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783071270.812028:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783071270.812181:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783071270.812352:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783071270.812517:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783071270.813126:0:5771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1783071270.834192:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783071270.868120:0:5771:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783071270.868146:0:5771:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6bc01c6b988 00100000:10000000:0.0:1783071270.868152:0:5771:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1783071270.869992:0:5826:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783071270.870049:0:5826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783071270.870052:0:5826:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1783071270.871115:0:5771:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783071270.871130:0:5771:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783071270.871144:0:5771:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783071270.871182:0:5771:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1783071271.076526:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071272.103860:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071273.123047:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071274.150368:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071274.556415:0:6068:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783071275.174955:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783071275.751505:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783071275.751525:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783071275.751528:0:8:0:(import.c:65:import_set_state_nolock()) 0000000086de7e07 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071275.751539:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000086de7e07 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071275.751577:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c6054cc x1869685684440320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071275.757962:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071275.757984:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684440192:0@lo:400: 00000100:00100000:3.0:1783071275.758054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071275.758121:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005c6054cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684440320:0@lo:38: 00000100:00100000:3.0:1783071275.758163:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071275.758203:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440192 00000100:00100000:3.0:1783071275.758209:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440192 00000100:00100000:3.0:1783071275.758247:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783071275.758254:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87b13f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3295:x1869685684440192:12345-0@lo:400: 00000100:00100000:3.0:1783071275.758300:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87b13f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3295:x1869685684440192:12345-0@lo:400: Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071275.758325:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783071275.758372:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008b789a1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684440192:0@lo:400: 00000100:00100000:3.0:1783071275.758409:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440320 00000100:00100000:3.0:1783071275.758412:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440320 00000100:00100000:3.0:1783071275.758431:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071275.758435:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f758e1df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1869685684440320:12345-0@lo:38: 00010000:00080000:3.0:1783071275.758454:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1783071275.758484:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd360fc6ce6ec6f3a 00000004:00100000:3.0:1783071275.758532:0:5793:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783071275.758646:0:5793:0:(import.c:65:import_set_state_nolock()) 00000000113bf6e9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071275.758721:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f758e1df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869685684440320:12345-0@lo:38: Request processed in 283us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071275.758727:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071275.758755:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005c6054cc x1869685684440320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783071275.758766:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783071275.758773:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783071275.758777:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783071275.758779:0:3291:0:(import.c:65:import_set_state_nolock()) 0000000086de7e07 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071275.758784:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005c6054cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684440320:0@lo:38: 00010000:00010000:0.0:1783071276.193259:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071277.219944:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071278.240890:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071278.310290:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071278.310298:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9782c8344000 from 3 10000000:01000000:0.0:1783071278.310303:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071278.310350:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.310361:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.310382:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071278.310407:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c66f4888 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684440448:0@lo:101: 00000100:00100000:0.0:1783071278.310473:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071278.310531:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a97341db going to sleep for 11 seconds 00000100:00100000:1.0:1783071278.310600:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440448 00000100:00100000:1.0:1783071278.310608:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440448 00000100:00100000:1.0:1783071278.310664:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783071278.310844:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b258093e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684440448:12345-0@lo:101: 00010000:00010000:1.0:1783071278.310858:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071278.311157:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053352c87/0xd360fc6ce6ec6f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f41 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.311179:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053352c87/0xd360fc6ce6ec6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.311188:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053352c87/0xd360fc6ce6ec6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.311197:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053352c87, rc 0) 00000100:00100000:0.0:1783071278.311245:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b258093e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684440448:12345-0@lo:101: Request processed in 574us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071278.311252:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783071278.311327:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c66f4888 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684440448:0@lo:101: 00010000:00010000:1.0:1783071278.311340:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.311347:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071278.311392:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7333f50 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684440576:0@lo:256: 00000100:00100000:1.0:1783071278.311420:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071278.311447:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fb7771ce going to sleep for 11 seconds 00000100:00100000:3.0:1783071278.311483:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440576 00000100:00100000:3.0:1783071278.311487:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440576 00000100:00100000:3.0:1783071278.311528:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783071278.311534:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d91643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684440576:12345-0@lo:256: 20000000:01000000:3.0:1783071278.311547:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071278.311567:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071278.311570:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783071278.311640:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d91643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684440576:12345-0@lo:256: Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071278.311647:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783071278.311737:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7333f50 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684440576:0@lo:256: 10000000:01000000:1.0:1783071278.311772:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071278.311777:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.311791:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 000000008edce6ba/0xd360fc6ce6ec6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783071278.727066:0:6270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff748dc390 20000000:00000080:0.0:1783071278.727087:0:6270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9782f9172800 uarg=0000000000000000 20000000:01000000:0.0:1783071278.727122:0:6270:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783071278.727128:0:6270:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783071278.727132:0:6270:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783071278.727329:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1783071278.727340:0:6270:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1783071278.731277:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071278.733653:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783071278.734361:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1783071278.734425:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1783071278.734448:0:6270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783071278.734466:0:6270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.734485:0:6270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.734503:0:6270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.734542:0:6270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.734557:0:6270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 11 pid: 5783 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071278.734571:0:6270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a23aece1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1869685684440704:0@lo:104: 00000100:00100000:0.0:1783071278.734636:0:6270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071278.734790:0:6270:0:(client.c:2701:ptlrpc_set_wait()) set 0000000067c8f8e2 going to sleep for 11 seconds 00000100:00100000:3.0:1783071278.737027:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440704 00000100:00100000:3.0:1783071278.737043:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440704 00000100:00100000:3.0:1783071278.737152:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071278.737162:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a2ab7a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:6270:x1869685684440704:12345-0@lo:104: 00010000:00010000:3.0:1783071278.737179:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071278.737276:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071278.737281:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a2ab7a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:6270:x1869685684440704:12345-0@lo:104: Request processed in 122us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071278.737288:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071278.737355:0:6270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a23aece1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1869685684440704:0@lo:104: 00010000:00010000:0.0:1783071278.737377:0:6270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737475:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071278.737480:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737487:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecd272cc already unused, calling callback (00000000becd8c43) 10000000:00010000:1.0:1783071278.737501:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737509:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071278.737515:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071278.737521:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071278.737570:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737577:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071278.737595:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737602:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000ecd272cc/0xd360fc6ce6ec6f09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f10 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737618:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071278.737633:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071278.737634:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071278.737649:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7333f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684440832:0@lo:103: 00000100:00100000:1.0:1783071278.737718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071278.737766:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440832 00000100:00100000:1.0:1783071278.737770:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440832 00010000:00010000:1.0:1783071278.737790:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 12 pid: 5783 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071278.737812:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071278.737818:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054213b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3295:x1869685684440832:12345-0@lo:103: 00010000:00010000:1.0:1783071278.737829:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071278.737833:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 12 pid: 5783 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737842:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 12 pid: 5783 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737855:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc94b2ad/0xd360fc6ce6ec6f10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f09 expref: 12 pid: 5783 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737868:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737875:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737887:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737893:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737903:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737908:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737913:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1965fb4 already unused, calling callback (000000008ece4b5b) 00010000:00010000:1.0:1783071278.737916:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737922:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737931:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071278.737941:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071278.737970:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054213b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3295:x1869685684440832:12345-0@lo:103: Request processed in 153us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071278.737976:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071278.738005:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7333f50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684440832:0@lo:103: 00010000:00010000:0.0:1783071278.738234:0:6270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.738241:0:6270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071278.738246:0:6270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1965fb4/0xd360fc6ce6ec6f4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071279.265402:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071280.288972:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071280.866256:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a23aece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684440960:0@lo:400: 00000100:00100000:1.0:1783071280.866330:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071280.866389:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071280.866395:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002461bf6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684441088:0@lo:400: 00000100:00100000:1.0:1783071280.866426:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071280.866492:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441088 00000100:00100000:1.0:1783071280.866512:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441088 00000100:00100000:1.0:1783071280.866556:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071280.866565:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7333f50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684441088:12345-0@lo:400: 00000100:00100000:1.0:1783071280.866616:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7333f50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684441088:12345-0@lo:400: Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071280.866623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783071280.866661:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002461bf6e x1869685684441088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071280.866694:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002461bf6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684441088:0@lo:400: 00000100:00100000:0.0:1783071280.866779:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684440960 00000100:00100000:0.0:1783071280.866784:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684440960 00000100:00100000:0.0:1783071280.866808:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783071280.866813:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e640e801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3292:x1869685684440960:12345-0@lo:400: 00000100:00100000:0.0:1783071280.866847:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e640e801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3292:x1869685684440960:12345-0@lo:400: Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071280.866853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071280.867261:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a23aece1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684440960:0@lo:400: 00010000:00010000:3.0:1783071281.313799:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071282.336969:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783071283.229996:0:6583:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783071283.230155:0:6583:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783071283.230263:0:6583:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000028a32237 00000020:01000004:2.0:1783071283.230280:0:6583:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783071283.230290:0:6583:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783071283.230303:0:6583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000002faa2891) 00000020:00000080:2.0:1783071283.230321:0:6583:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783071283.262651:0:6583:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783071283.265804:0:6583:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783071283.295230:0:6583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1783071283.301337:0:6583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783071283.301372:0:6583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1783071283.301428:0:6583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783071283.301464:0:6583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1783071283.302172:0:6583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783071283.302184:0:6583:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783071283.302194:0:6583:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd360fc6ce6ec6f5d 00000020:01000004:1.0:1783071283.302202:0:6583:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1783071283.302223:0:6583:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783071283.302226:0:6583:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783071283.302234:0:6583:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783071283.302238:0:6583:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783071283.302249:0:6583:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000011bf27ad) 00000020:00000080:1.0:1783071283.302261:0:6583:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1783071283.303562:0:6583:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071283.303748:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783071283.303761:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783071283.309499:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071283.309513:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783071283.311353:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783071283.311364:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783071283.315275:0:6583:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071283.315465:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071283.315471:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783071283.317193:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783071283.317203:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783071283.346110:0:6583:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071283.346412:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783071283.346419:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783071283.348088:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783071283.348101:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783071283.350007:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783071283.350027:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783071283.352501:0:6583:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071283.352956:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071283.352964:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783071283.353482:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071283.353490:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1783071283.361085:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071283.431019:0:6583:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071283.431202:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071283.431210:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783071283.434077:0:6583:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071283.434097:0:6583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783071283.435089:0:6583:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783071283.435120:0:6583:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783071283.435126:0:6583:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783071283.480527:0:6583:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783071283.480571:0:6583:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783071283.480575:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783071283.480577:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071283.480579:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071283.480580:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071283.480581:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071283.480582:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071283.480584:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071283.480585:0:6583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071283.480587:0:6583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071283.480588:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071283.480590:0:6583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071283.480598:0:6583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783071283.480601:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071283.480602:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071283.480603:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071283.480604:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071283.480605:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071283.480606:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071283.480606:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071283.480607:0:6583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783071283.480608:0:6583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783071283.480609:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071283.480610:0:6583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783071283.480638:0:6583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783071283.481030:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e4ac027d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684441216:0@lo:253: 00000100:00100000:3.0:1783071283.481103:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.481233:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 000000002131b08e going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.481278:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441216 00000100:00100000:0.0:1783071283.481286:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441216 00000100:00100000:0.0:1783071283.481376:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071283.481385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa28441c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684441216:12345-0@lo:253: 20000000:01000000:0.0:1783071283.481414:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783071283.481417:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1783071283.481422:0:5784:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1783071283.481425:0:5784:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1783071283.482254:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071283.482442:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783071283.482465:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1783071283.482500:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1783071283.482507:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1783071283.482529:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1783071283.482566:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1783071283.482891:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783071283.482909:0:5784:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1783071283.482922:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1783071283.482953:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783071283.482960:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783071283.483005:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783071283.483012:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1783071283.483038:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783071283.483046:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783071283.483068:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783071283.483105:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1783071283.483786:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783071283.483800:0:5784:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:0.0:1783071283.483802:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:0.0:1783071283.483828:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783071283.483834:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783071283.483856:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783071283.483861:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:0.0:1783071283.483908:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783071283.483916:0:5784:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783071283.483940:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1783071283.483966:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1783071283.483979:0:5784:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783071283.483983:0:5784:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783071283.483986:0:5784:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783071283.483997:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783071283.483999:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783071283.484024:0:5784:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783071283.484026:0:5784:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783071283.485145:0:6598:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783071283.485206:0:6598:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783071283.485244:0:6598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783071283.485538:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783071283.485592:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1783071283.486087:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1783071283.486107:0:5784:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783071283.486109:0:5784:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783071283.486507:0:6599:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783071283.487422:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783071283.487472:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783071283.487534:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783071283.487546:0:5784:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783071283.487548:0:5784:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071283.488300:0:6600:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071283.488355:0:6600:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071283.488403:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783071283.489035:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1783071283.489084:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1783071283.489121:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1783071283.489137:0:5784:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1783071283.489140:0:5784:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1783071283.489152:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783071283.489171:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489348:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489364:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489370:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489377:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489414:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489429:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 11 pid: 5783 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.489446:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ee290c2f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441344:0@lo:104: 00000100:00100000:3.0:1783071283.489524:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071283.489622:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.489630:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.489637:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000076f8abdd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441472:0@lo:104: 00000100:00100000:3.0:1783071283.489669:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071283.490037:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.490046:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 11 pid: 5784 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.490062:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a20457d6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441600:0@lo:104: 00000100:00100000:3.0:1783071283.490084:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.490162:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441344 00000100:00100000:2.0:1783071283.490170:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441344 00000100:00100000:2.0:1783071283.490207:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441472 00000100:00100000:2.0:1783071283.490209:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441472 00000100:00100000:2.0:1783071283.490219:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071283.490227:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000045c9c62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5784:x1869685684441344:12345-0@lo:104: 00010000:00010000:2.0:1783071283.490239:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.490327:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071283.490333:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000045c9c62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5784:x1869685684441344:12345-0@lo:104: Request processed in 106us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.490340:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071283.490358:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071283.490363:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8b82df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5784:x1869685684441472:12345-0@lo:104: 00010000:00010000:2.0:1783071283.490369:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.490419:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000001b54aa5d going to sleep for 11 seconds 00000100:00100000:3.0:1783071283.490439:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ee290c2f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441344:0@lo:104: 00000100:00100000:3.0:1783071283.490446:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000076f8abdd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441472:0@lo:104: 00000100:00100000:0.0:1783071283.490484:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441600 00000100:00100000:0.0:1783071283.490494:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441600 00010000:00010000:1.0:1783071283.490534:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071283.490539:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.490547:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058fa23d6 already unused, calling callback (00000000becd8c43) 10000000:00010000:1.0:1783071283.490550:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.490557:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071283.490565:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071283.490570:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071283.490602:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.490618:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783071283.490931:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000871fa010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684441728:0@lo:103: 00000100:00100000:3.0:1783071283.490964:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071283.491042:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441728 00000100:00100000:0.0:1783071283.491047:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441728 00010000:00010000:0.0:1783071283.491066:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071283.491096:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071283.491103:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2f27266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3294:x1869685684441728:12345-0@lo:103: 00010000:00010000:0.0:1783071283.491114:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071283.491118:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.491127:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.491141:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000baee295b/0xd360fc6ce6ec6f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f17 expref: 12 pid: 5783 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.491156:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071283.491188:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2f27266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3294:x1869685684441728:12345-0@lo:103: Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.491195:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071283.491220:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000871fa010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684441728:0@lo:103: 00010000:00010000:1.0:1783071283.491324:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491332:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 0000000058fa23d6/0xd360fc6ce6ec6f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f1e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491344:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071283.491347:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491353:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e74551a9 already unused, calling callback (00000000becd8c43) 10000000:00010000:1.0:1783071283.491355:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491362:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071283.491367:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071283.491372:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071283.491398:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491404:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071283.491419:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491425:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000e74551a9/0xd360fc6ce6ec6ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6eae expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491444:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071283.491445:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071283.491447:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071283.491467:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d9e371f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684441856:0@lo:103: 00000100:00100000:1.0:1783071283.491494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071283.491522:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441856 00000100:00100000:1.0:1783071283.491526:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441856 00010000:00010000:1.0:1783071283.491540:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071283.491556:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071283.491561:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ada81c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:3295:x1869685684441856:12345-0@lo:103: 00010000:00010000:1.0:1783071283.491569:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071283.491572:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491579:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491587:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030306fa1/0xd360fc6ce6ec6eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ea7 expref: 11 pid: 5785 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.491596:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071283.491621:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ada81c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:3295:x1869685684441856:12345-0@lo:103: Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071283.491627:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071283.491983:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d9e371f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684441856:0@lo:103: 00010000:00010000:2.0:1783071283.492094:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783071283.492101:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8b82df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5784:x1869685684441472:12345-0@lo:104: Request processed in 1738us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.492109:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783071283.492172:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071283.492184:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071283.492191:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b335d433 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5784:x1869685684441600:12345-0@lo:104: 00010000:00010000:3.0:1783071283.492202:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492296:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071283.492302:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b335d433 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5784:x1869685684441600:12345-0@lo:104: Request processed in 112us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.492308:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783071283.492351:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071283.492355:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.492362:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b2eca35 already unused, calling callback (00000000becd8c43) 10000000:00010000:1.0:1783071283.492364:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.492370:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071283.492375:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071283.492379:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071283.492409:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.492415:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071283.492440:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.492446:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 000000009b2eca35/0xd360fc6ce6ec6e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6e92 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.492470:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071283.492472:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071283.492473:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071283.492479:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071283.492489:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d9e371f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684441984:0@lo:103: 00000100:00100000:1.0:1783071283.492525:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.492635:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684441984 00000100:00100000:3.0:1783071283.492641:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684441984 00010000:00010000:3.0:1783071283.492668:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 10 pid: 5784 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.492724:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071283.492730:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073f6ec0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:3293:x1869685684441984:12345-0@lo:103: 00010000:00010000:3.0:1783071283.492739:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071283.492759:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 10 pid: 5784 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492768:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 10 pid: 5784 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492781:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492788:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492801:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492807:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492813:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492818:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.492823:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001fa8b5f9 already unused, calling callback (000000008ece4b5b) 00010000:00010000:3.0:1783071283.493018:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.493025:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.493033:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.493053:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071283.493092:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073f6ec0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:3293:x1869685684441984:12345-0@lo:103: Request processed in 363us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.493099:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071283.493160:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d9e371f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684441984:0@lo:103: 00010000:00010000:0.0:1783071283.493259:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a568e45f/0xd360fc6ce6ec6e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6e8b expref: 9 pid: 5784 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071283.493271:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a20457d6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5784:1869685684441600:0@lo:104: 00010000:00010000:0.0:1783071283.493289:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.493306:0:5784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.493311:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.493315:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001fa8b5f9/0xd360fc6ce6ec6f6b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783071283.493326:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783071283.526550:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa28441c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:6583:x1869685684441216:12345-0@lo:253: Request processed in 45159us (45441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.526566:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071283.526919:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e4ac027d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684441216:0@lo:253: 10000000:01000000:2.0:1783071283.526937:0:6583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783071283.526940:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783071283.526942:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071283.526956:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071283.526958:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783071283.526959:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071283.526960:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071283.526962:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071283.526963:0:6583:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783071283.526965:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071283.526966:0:6583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783071283.526985:0:6583:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000028a32237 from lustre-OST0000 10000000:01000000:2.0:1783071283.527008:0:6583:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783071283.527011:0:6583:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783071283.527017:0:6583:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9782c5bbb380 local copy 10000000:01000000:2.0:1783071283.527021:0:6583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071283.527060:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.527071:0:6583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.527079:0:6583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071283.527098:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f4260ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442112:0@lo:101: 00000100:00100000:2.0:1783071283.527133:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.527220:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000217a2e98 going to sleep for 11 seconds 00000100:00100000:1.0:1783071283.527291:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442112 00000100:00100000:1.0:1783071283.527297:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442112 00000100:00100000:1.0:1783071283.527365:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071283.527372:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cce52a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:6583:x1869685684442112:12345-0@lo:101: 00010000:00010000:1.0:1783071283.527384:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071283.527396:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e64dd33/0xd360fc6ce6ec6f79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f72 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.527416:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e64dd33/0xd360fc6ce6ec6f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f72 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.527423:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e64dd33/0xd360fc6ce6ec6f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f72 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071283.527431:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e64dd33, rc 0) 00000100:00100000:1.0:1783071283.527476:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cce52a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:6583:x1869685684442112:12345-0@lo:101: Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071283.527482:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071283.527547:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f4260ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442112:0@lo:101: 00010000:00010000:3.0:1783071283.527561:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.527567:0:6583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.527670:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442240:0@lo:501: 00000100:00100000:3.0:1783071283.527731:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.528056:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 000000004732df4e going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.528109:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442240 00000100:00100000:2.0:1783071283.528113:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442240 00000100:00100000:2.0:1783071283.528133:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071283.528138:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000538bee8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:6583:x1869685684442240:12345-0@lo:501: 00000100:00100000:2.0:1783071283.528335:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000538bee8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:6583:x1869685684442240:12345-0@lo:501: Request processed in 197us (604us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071283.528343:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071283.528426:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442240:0@lo:501: 10000000:01000000:3.0:1783071283.528445:0:6583:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783071283.528481:0:6583:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783071283.528485:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.528493:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.528509:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.528533:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783071283.528550:0:6583:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9782f9bac800 10000000:01000000:3.0:1783071283.528555:0:6583:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783071283.528558:0:6583:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9782c5bbb380 10000000:01000000:3.0:1783071283.528560:0:6583:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783071283.528563:0:6583:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9782c5bbb380 from 1 10000000:01000000:3.0:1783071283.528565:0:6583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783071283.528581:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.528589:0:6583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.528596:0:6583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.528608:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442368:0@lo:101: 00000100:00100000:3.0:1783071283.528635:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.528659:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00010000:00010000:2.0:1783071283.528895:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071283.528900:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.528907:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aa4505f4 already unused, calling callback (00000000becd8c43) 10000000:00010000:2.0:1783071283.528910:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.528916:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071283.528922:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071283.528927:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071283.528943:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.528949:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071283.528970:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.528976:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: 00000000aa4505f4/0xd360fc6ce6ec6f72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec6f79 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.528991:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071283.528993:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071283.528994:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071283.529004:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442368 00000100:00100000:2.0:1783071283.529007:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442368 00000100:00100000:2.0:1783071283.529027:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071283.529033:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a91be7ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:6583:x1869685684442368:12345-0@lo:101: 00010000:00010000:2.0:1783071283.529047:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071283.529059:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6f87 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f80 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529074:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6f87 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f80 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529082:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b2eca35/0xd360fc6ce6ec6f87 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f80 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529089:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b2eca35, rc 0) 00000100:00100000:2.0:1783071283.529118:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a91be7ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442368:12345-0@lo:101: Request processed in 86us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.529124:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071283.529188:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000044b82236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684442496:0@lo:103: 00000100:00100000:3.0:1783071283.529216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.529258:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442496 00000100:00100000:3.0:1783071283.529261:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442496 00000100:00100000:3.0:1783071283.529295:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071283.529301:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067836633 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:3293:x1869685684442496:12345-0@lo:103: 00010000:00010000:3.0:1783071283.529315:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071283.529324:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e64dd33/0xd360fc6ce6ec6f79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f72 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.529335:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071283.529356:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067836633 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:3293:x1869685684442496:12345-0@lo:103: Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.529361:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071283.529381:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000044b82236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684442496:0@lo:103: 00000100:00100000:3.0:1783071283.529398:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442368:0@lo:101: 00010000:00010000:3.0:1783071283.529408:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.529414:0:6583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071283.529424:0:6583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783071283.529431:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.529436:0:6583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000dfe0b26f/0xd360fc6ce6ec6f80 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071283.529441:0:6583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783071283.529445:0:6583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071283.529448:0:6583:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783071283.529450:0:6583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783071283.529473:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.529485:0:6583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.529492:0:6583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.529502:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442624:0@lo:101: 00000100:00100000:3.0:1783071283.529526:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.529537:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.529594:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442624 00000100:00100000:2.0:1783071283.529598:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442624 00000100:00100000:2.0:1783071283.529615:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071283.529620:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058a66f2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:6583:x1869685684442624:12345-0@lo:101: 00010000:00010000:2.0:1783071283.529626:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071283.529633:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e74551a9/0xd360fc6ce6ec6f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6f8e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529904:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e74551a9/0xd360fc6ce6ec6f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529914:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e74551a9/0xd360fc6ce6ec6f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.529920:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e74551a9, rc 0) 00000100:00100000:2.0:1783071283.529949:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058a66f2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442624:12345-0@lo:101: Request processed in 330us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.529956:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071283.530018:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442624:0@lo:101: 00010000:00010000:3.0:1783071283.530028:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.530036:0:6583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.530117:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442752:0@lo:501: 00000100:00100000:3.0:1783071283.530142:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.530161:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.530196:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442752 00000100:00100000:2.0:1783071283.530200:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442752 00000100:00100000:2.0:1783071283.530215:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071283.530220:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190df9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442752:12345-0@lo:501: 00000100:00100000:2.0:1783071283.530468:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190df9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442752:12345-0@lo:501: Request processed in 247us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.530475:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071283.530967:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442752:0@lo:501: 00000100:00100000:3.0:1783071283.531002:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442880:0@lo:503: 00000100:00100000:3.0:1783071283.531040:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.531097:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.531128:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684442880 00000100:00100000:2.0:1783071283.531132:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684442880 00000100:00100000:2.0:1783071283.531196:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071283.531203:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072b60460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442880:12345-0@lo:503: 00000100:00100000:2.0:1783071283.531355:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072b60460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684442880:12345-0@lo:503: Request processed in 153us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.531361:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783071283.531421:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684442880:0@lo:503: 00000040:00080000:3.0:1783071283.531764:0:6583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071283.531851:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443008:0@lo:502: 00000100:00100000:3.0:1783071283.531889:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.532186:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00000100:00100000:1.0:1783071283.532218:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443008 00000100:00100000:1.0:1783071283.532223:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443008 00000100:00100000:1.0:1783071283.532247:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071283.532253:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9aa7118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684443008:12345-0@lo:502: 00000100:00100000:1.0:1783071283.532501:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9aa7118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684443008:12345-0@lo:502: Request processed in 247us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071283.532507:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071283.532588:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443008:0@lo:502: 00000040:00080000:3.0:1783071283.536179:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783071283.536269:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783071283.536301:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783071283.536346:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783071283.536376:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783071283.536405:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783071283.536463:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443136:0@lo:502: 00000100:00100000:3.0:1783071283.536543:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.536593:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b004b724 going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.538910:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443136 00000100:00100000:0.0:1783071283.538926:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443136 00000100:00100000:0.0:1783071283.538986:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071283.538995:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fff3c521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684443136:12345-0@lo:502: 00000100:00100000:0.0:1783071283.539259:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fff3c521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684443136:12345-0@lo:502: Request processed in 265us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.539267:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783071283.540900:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443136:0@lo:502: 00000040:00080000:3.0:1783071283.541086:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783071283.541102:0:6583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1783071283.546333:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783071283.546347:0:6602:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783071283.546354:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071283.546369:0:6602:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783071283.546375:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071283.546390:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000008624c864) 00000020:00000080:1.0:1783071283.546411:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783071283.546416:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783071283.546503:0:6602:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000028a32237 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783071283.546510:0:6602:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783071283.546517:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd360fc6ce6ec6fa3 00010000:00010000:1.0:1783071283.552426:0:6602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1783071283.553195:0:6602:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1783071283.555665:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783071283.557056:0:6602:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1783071283.564527:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783071283.566113:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783071283.567584:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783071283.567596:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071283.567602:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071283.567605:0:6602:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783071283.567609:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071283.568716:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071283.568721:0:6602:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783071283.568728:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783071283.568730:0:6602:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783071283.568929:0:6602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071283.568933:0:6602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071283.568935:0:6602:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071283.568938:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783071283.569013:0:6583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783071283.569045:0:6583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783071283.569063:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.569076:0:6583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: 00000000ef8e435f/0xd360fc6ce6ec6f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071283.569086:0:6583:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782f9bac800 from 1 10000000:01000000:3.0:1783071283.569091:0:6583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071283.569140:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: 000000005645543f/0xd360fc6ce6ec6faa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.569148:0:6583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: 000000005645543f/0xd360fc6ce6ec6faa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.569160:0:6583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: 000000005645543f/0xd360fc6ce6ec6faa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.569184:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443264:0@lo:101: 00000100:00100000:3.0:1783071283.569262:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.569307:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081f32748 going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.569949:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443264 00000100:00100000:2.0:1783071283.569958:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443264 00000100:00100000:2.0:1783071283.570013:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071283.570022:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000519868f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:6583:x1869685684443264:12345-0@lo:101: 00010000:00010000:2.0:1783071283.570038:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071283.570056:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa4505f4/0xd360fc6ce6ec6fb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6faa expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.570080:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa4505f4/0xd360fc6ce6ec6fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.570101:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa4505f4/0xd360fc6ce6ec6fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.570109:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa4505f4, rc 0) 00000100:00100000:2.0:1783071283.570162:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000519868f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443264:12345-0@lo:101: Request processed in 141us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.570168:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783071283.570954:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443264:0@lo:101: 00010000:00010000:3.0:1783071283.570982:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: 000000005645543f/0xd360fc6ce6ec6faa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.570992:0:6583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: 000000005645543f/0xd360fc6ce6ec6faa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.571103:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443392:0@lo:501: 00000100:00100000:3.0:1783071283.571154:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.573050:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081f32748 going to sleep for 11 seconds 00000100:00100000:2.0:1783071283.578113:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443392 00000100:00100000:2.0:1783071283.578132:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443392 00000100:00100000:2.0:1783071283.578259:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783071283.578268:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ef3008d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443392:12345-0@lo:501: 00000100:00100000:2.0:1783071283.578578:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ef3008d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443392:12345-0@lo:501: Request processed in 311us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.578587:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783071283.578694:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443392:0@lo:501: 00000100:00100000:3.0:1783071283.578758:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443520:0@lo:503: 00000100:00100000:3.0:1783071283.578805:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.581480:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081f32748 going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.581572:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443520 00000100:00100000:0.0:1783071283.581581:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443520 00000100:00100000:0.0:1783071283.581630:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071283.581638:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000305a4d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443520:12345-0@lo:503: 00000100:00100000:0.0:1783071283.582199:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000305a4d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443520:12345-0@lo:503: Request processed in 560us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.582208:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783071283.582330:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443520:0@lo:503: 00000040:00080000:3.0:1783071283.582636:0:6583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071283.582739:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443648:0@lo:502: 00000100:00100000:3.0:1783071283.582797:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.582820:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081f32748 going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.583172:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443648 00000100:00100000:0.0:1783071283.583178:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443648 00000100:00100000:0.0:1783071283.583205:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071283.583210:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1036afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443648:12345-0@lo:502: 00000100:00100000:0.0:1783071283.583388:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1036afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443648:12345-0@lo:502: Request processed in 178us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.583395:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783071283.583483:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443648:0@lo:502: 00000040:00080000:3.0:1783071283.584065:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783071283.584115:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783071283.584140:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443776:0@lo:502: 00000100:00100000:3.0:1783071283.584177:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.584200:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081f32748 going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.584261:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443776 00000100:00100000:0.0:1783071283.584266:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443776 00000100:00100000:0.0:1783071283.584286:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071283.584292:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000855f4c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443776:12345-0@lo:502: 00000100:00100000:0.0:1783071283.584424:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000855f4c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443776:12345-0@lo:502: Request processed in 132us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.584432:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071283.584899:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022d8a806 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443776:0@lo:502: 00000040:00080000:3.0:1783071283.585062:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783071283.585073:0:6583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783071283.585567:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071283.585576:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071283.585578:0:6606:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071283.585584:0:6606:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782f9bac800 00000020:00000080:3.0:1783071283.585586:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071283.585819:0:6606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071283.585939:0:6606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071283.585940:0:6606:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783071283.585944:0:6606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783071283.586119:0:6583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783071283.586139:0:6583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071283.586158:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.586170:0:6583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071283.586208:0:6583:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783071283.586211:0:6583:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9782f9bac800 10000000:01000000:2.0:1783071283.586214:0:6583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9782f9bac800 10000000:01000000:2.0:1783071283.586218:0:6583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071283.586223:0:6583:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782f9bac800 from 1 10000000:01000000:2.0:1783071283.586225:0:6583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071283.586256:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.586265:0:6583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.586274:0:6583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071283.586293:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443904:0@lo:101: 00000100:00100000:2.0:1783071283.586341:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.586431:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071283.586553:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684443904 00000100:00100000:1.0:1783071283.586559:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684443904 00000100:00100000:0.0:1783071283.586631:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071283.586640:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684443904:12345-0@lo:101: 00010000:00010000:0.0:1783071283.586816:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071283.586893:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6fb8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.586917:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.586927:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071283.586936:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031000, rc 0) 00000100:00100000:0.0:1783071283.587087:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684443904:12345-0@lo:101: Request processed in 448us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.587094:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071283.587281:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684443904:0@lo:101: 00010000:00010000:2.0:1783071283.587294:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.587303:0:6583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071283.587392:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444032:0@lo:501: 00000100:00100000:2.0:1783071283.587418:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.587535:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071283.587609:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444032 00000100:00100000:3.0:1783071283.587621:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444032 00000100:00100000:3.0:1783071283.587656:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071283.587663:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444032:12345-0@lo:501: 00000100:00100000:3.0:1783071283.588175:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444032:12345-0@lo:501: Request processed in 512us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.588183:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071283.588268:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444032:0@lo:501: 00000100:00100000:2.0:1783071283.588298:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444160:0@lo:503: 00000100:00100000:2.0:1783071283.588336:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.588368:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071283.588418:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444160 00000100:00100000:3.0:1783071283.588422:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444160 00000100:00100000:3.0:1783071283.588442:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783071283.588448:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444160:12345-0@lo:503: 00000100:00100000:3.0:1783071283.588604:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444160:12345-0@lo:503: Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.588612:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071283.588753:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444160:0@lo:503: 00000040:00080000:2.0:1783071283.589148:0:6583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071283.589222:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444288:0@lo:502: 00000100:00100000:2.0:1783071283.589259:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.589449:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071283.590109:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444288 00000100:00100000:3.0:1783071283.590117:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444288 00000100:00100000:3.0:1783071283.590153:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071283.590162:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444288:12345-0@lo:502: 00000100:00100000:3.0:1783071283.590381:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444288:12345-0@lo:502: Request processed in 219us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.590388:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783071283.590478:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444288:0@lo:502: 00000040:00080000:2.0:1783071283.591051:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783071283.591106:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783071283.591144:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783071283.591188:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783071283.591227:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783071283.591275:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783071283.591313:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783071283.591350:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783071283.591398:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783071283.591437:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783071283.591500:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783071283.591549:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783071283.591585:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783071283.591618:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783071283.592343:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783071283.592397:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783071283.592427:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783071283.592486:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783071283.592522:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783071283.592554:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783071283.592618:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783071283.592667:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783071283.592729:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783071283.593209:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783071283.593248:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783071283.593285:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783071283.593352:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783071283.593398:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1783071283.593462:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444416:0@lo:502: 00000100:00100000:2.0:1783071283.593540:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.593733:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071283.594196:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444416 00000100:00100000:1.0:1783071283.594205:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444416 00000100:00100000:1.0:1783071283.594252:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071283.594260:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444416:12345-0@lo:502: 00000100:00100000:1.0:1783071283.594512:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444416:12345-0@lo:502: Request processed in 251us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071283.594521:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071283.594637:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444416:0@lo:502: 00000040:00080000:2.0:1783071283.594765:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783071283.594778:0:6583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1783071283.596150:0:6607:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783071283.596169:0:6607:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9782c6714d40) 00000020:00000080:1.0:1783071283.596190:0:6607:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1783071283.598239:0:6607:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782f9bac800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071283.598249:0:6607:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782f9bac800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783071283.598253:0:6607:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782f9bac800 3 00010000:00080000:2.0:1783071283.598292:0:6607:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9781c49ef800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071283.601513:0:6607:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1783071283.601623:0:6607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783071283.602260:0:6607:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783071283.602276:0:6607:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd360fc6ce6ec6fcd 00000100:00080000:2.0:1783071283.602288:0:6607:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071283.602294:0:6607:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9781c49ef800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1783071283.602328:0:6607:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782c3e26a00 x1869685684444544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071283.602358:0:6607:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783071283.602405:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684444544:0@lo:38: 00000100:00100000:1.0:1783071283.602494:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071283.602695:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444544 00000100:00100000:3.0:1783071283.602703:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444544 00000100:00100000:3.0:1783071283.602735:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783071283.602754:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1869685684444544:12345-0@lo:38: 00010000:00080000:3.0:1783071283.602785:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1783071283.602813:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd360fc6ce6ec6fd4 00000004:00100000:3.0:1783071283.602838:0:5791:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783071283.602866:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9782f9ea6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071283.602917:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869685684444544:12345-0@lo:38: Request processed in 173us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071283.602924:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783071283.603163:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9782c3e26a00 x1869685684444544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071283.603173:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783071283.603181:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783071283.603187:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783071283.603191:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783071283.603193:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c49ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783071283.603199:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684444544:0@lo:38: 00000100:00100000:1.0:1783071283.611318:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684444672:0@lo:400: 00000100:00100000:1.0:1783071283.611382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783071283.613639:0:6607:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783071283.613987:0:6583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783071283.614014:0:6583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071283.614035:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.614047:0:6583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783071283.614108:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783071283.614110:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071283.614112:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071283.614113:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071283.614114:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071283.614115:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071283.614117:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071283.614118:0:6583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071283.614120:0:6583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071283.614122:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071283.614123:0:6583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071283.614126:0:6583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783071283.614128:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071283.614130:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071283.614131:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071283.614132:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071283.614133:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071283.614134:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071283.614135:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071283.614135:0:6583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783071283.614136:0:6583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783071283.614137:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071283.614138:0:6583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071283.614162:0:6583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783071283.614180:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444800:0@lo:253: 00000100:00100000:2.0:1783071283.614245:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.614285:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071283.614862:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444672 00000100:00100000:0.0:1783071283.614870:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444672 00000100:00100000:0.0:1783071283.614940:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071283.615123:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684444672:12345-0@lo:400: 00000100:00100000:1.0:1783071283.615419:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444800 00000100:00100000:1.0:1783071283.615424:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444800 00000100:00100000:1.0:1783071283.615554:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071283.615564:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6583:x1869685684444800:12345-0@lo:253: 20000000:01000000:1.0:1783071283.615586:0:5784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071283.615600:0:5784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783071283.616815:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684444672:12345-0@lo:400: Request processed in 1859us (5425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071283.616836:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783071283.617198:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9782f9ed2d80 x1869685684444672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071283.617216:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684444672:0@lo:400: 20000000:01000000:1.0:1783071283.677067:0:5784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783071283.677086:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783071283.677194:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783071283.677198:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783071283.677218:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.677235:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.677244:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.677282:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.677310:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.677324:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684444928:0@lo:104: 00000100:00100000:3.0:1783071283.677391:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.677549:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684444928 00000100:00100000:2.0:1783071283.677557:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684444928 00000100:00100000:2.0:1783071283.677600:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071283.677609:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684444928:12345-0@lo:104: 00010000:00010000:2.0:1783071283.677621:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677716:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071283.677723:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684444928:12345-0@lo:104: Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.677730:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783071283.677753:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071283.677757:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677764:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071283.677767:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677775:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071283.677781:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071283.677786:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071283.677810:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677817:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071283.677846:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677854:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec6f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.677883:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071283.677885:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071283.677886:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071283.677900:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071283.677912:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684445056:0@lo:103: 00000100:00100000:2.0:1783071283.677944:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071283.678103:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445056 00000100:00100000:2.0:1783071283.678108:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445056 00010000:00010000:2.0:1783071283.678126:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 13 pid: 5785 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071283.678148:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071283.678154:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c625b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3294:x1869685684445056:12345-0@lo:103: 00010000:00010000:2.0:1783071283.678165:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071283.678170:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 13 pid: 5785 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678180:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 13 pid: 5785 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678194:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678202:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071283.678212:0:5776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001090937s 00010000:00010000:2.0:1783071283.678217:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678246:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678252:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678259:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678264:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071283.678268:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678275:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678284:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071283.678294:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071283.678324:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c625b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3294:x1869685684445056:12345-0@lo:103: Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.678330:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071283.678548:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0240 going to sleep for 11 seconds 00010000:00010000:3.0:1783071283.678569:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec6f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f41 expref: 12 pid: 5785 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071283.678580:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684444928:0@lo:104: 00010000:00010000:3.0:1783071283.678598:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.678606:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.678611:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071283.678616:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec6fdb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071283.679377:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684445056:0@lo:103: 00000100:00100000:2.0:1783071283.687701:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:6583:x1869685684444800:12345-0@lo:253: Request processed in 72109us (73425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071283.687716:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071283.687929:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6583:1869685684444800:0@lo:253: 10000000:01000000:1.0:1783071283.687946:0:6583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783071283.688017:0:6583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783071283.688018:0:6583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783071283.688020:0:6583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071283.688021:0:6583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071283.688022:0:6583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071283.688023:0:6583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071283.688024:0:6583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071283.688025:0:6583:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071283.688027:0:6583:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071283.688028:0:6583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071283.688029:0:6583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783071283.688044:0:6583:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783071283.692743:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071283.693140:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783071283.693369:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071283.693641:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783071283.694126:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071283.694387:0:6583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783071283.697024:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783071283.942522:0:6583:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783071283.942529:0:6583:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783071283.942560:0:6583:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783071283.942612:0:6583:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783071283.942638:0:6583:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783071283.942697:0:6583:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783071284.385515:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783071284.964894:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783071284.964901:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c8344000 from 21 10000000:01000000:1.0:1783071284.964906:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071284.964948:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.964960:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.964971:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071284.964993:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445184:0@lo:101: 00000100:00100000:1.0:1783071284.965062:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071284.965110:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c49483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071284.965130:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445184 00000100:00100000:1.0:1783071284.965137:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445184 00000100:00100000:1.0:1783071284.965182:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071284.965190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684445184:12345-0@lo:101: 00010000:00010000:1.0:1783071284.965203:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071284.965215:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6fe2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.965238:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.965258:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.965266:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7800, rc 0) 00000100:00100000:1.0:1783071284.965303:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445184:12345-0@lo:101: Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071284.965309:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071284.965356:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445184:0@lo:101: 00010000:00010000:1.0:1783071284.965371:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071284.965380:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071284.965428:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445312:0@lo:501: 00000100:00100000:1.0:1783071284.965467:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071284.965480:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c49483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071284.968159:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445312 00000100:00100000:2.0:1783071284.968178:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445312 00000100:00100000:2.0:1783071284.968226:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071284.968235:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445312:12345-0@lo:501: 00000100:00100000:2.0:1783071284.971765:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445312:12345-0@lo:501: Request processed in 401us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071284.971781:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071284.971962:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445312:0@lo:501: 00000100:00100000:2.0:1783071284.972015:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445440:0@lo:503: 00000100:00100000:2.0:1783071284.972078:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071284.972119:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071284.972133:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445440 00000100:00100000:2.0:1783071284.972139:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445440 00000100:00100000:2.0:1783071284.972175:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071284.972182:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445440:12345-0@lo:503: 00000100:00100000:2.0:1783071285.006257:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445440:12345-0@lo:503: Request processed in 34064us (34168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.006271:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783071285.008279:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445440:0@lo:503: 00000100:00100000:2.0:1783071285.008521:0:6676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6676:1869685684445568:0@lo:502: 00000100:00100000:2.0:1783071285.008589:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.008625:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445568 00000100:00100000:2.0:1783071285.008760:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445568 00000100:00100000:2.0:1783071285.008806:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071285.008826:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6676:x1869685684445568:12345-0@lo:502: 00000100:00100000:2.0:1783071285.009130:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6676:x1869685684445568:12345-0@lo:502: Request processed in 315us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.009147:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783071285.009204:0:6676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.009218:0:6676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6676:1869685684445568:0@lo:502: 00000100:00100000:2.0:1783071285.009260:0:6676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6676:1869685684445696:0@lo:502: 00000100:00100000:2.0:1783071285.009292:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.009314:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445696 00000100:00100000:2.0:1783071285.009317:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445696 00000100:00100000:2.0:1783071285.009337:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783071285.009343:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6676:x1869685684445696:12345-0@lo:502: 00000100:00100000:2.0:1783071285.009593:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:6676:x1869685684445696:12345-0@lo:502: Request processed in 249us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.009600:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783071285.009628:0:6676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.009724:0:6676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6676:1869685684445696:0@lo:502: 00000040:00080000:2.0:1783071285.009742:0:6676:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783071285.009794:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783071285.009877:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071285.009887:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.009897:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071285.009906:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071285.009909:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9782c8344000 from 4 10000000:01000000:2.0:1783071285.009911:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071285.009937:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.009952:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.009960:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.009972:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445824:0@lo:101: 00000100:00100000:2.0:1783071285.009997:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.010011:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.010023:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445824 00000100:00100000:2.0:1783071285.010027:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445824 00000100:00100000:2.0:1783071285.010047:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071285.010053:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684445824:12345-0@lo:101: 00010000:00010000:2.0:1783071285.010062:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071285.010076:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6ff0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.010097:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.010107:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.010116:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c800, rc 0) 00000100:00100000:2.0:1783071285.010144:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684445824:12345-0@lo:101: Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.010150:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783071285.010179:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445824:0@lo:101: 00010000:00010000:2.0:1783071285.010197:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.010204:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.010240:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445952:0@lo:256: 00000100:00100000:2.0:1783071285.010268:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.010280:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.010292:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684445952 00000100:00100000:2.0:1783071285.010295:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684445952 00000100:00100000:2.0:1783071285.010315:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071285.010321:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684445952:12345-0@lo:256: 20000000:01000000:2.0:1783071285.010335:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071285.010350:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071285.010352:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783071285.012945:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684445952:12345-0@lo:256: Request processed in 2612us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.012959:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071285.013025:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684445952:0@lo:256: 10000000:01000000:2.0:1783071285.013076:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071285.013087:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013097:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071285.013107:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783071285.013116:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1783071285.013119:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071285.013162:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013169:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013179:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.013196:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446080:0@lo:101: 00000100:00100000:2.0:1783071285.013229:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.013252:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.013268:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446080 00000100:00100000:2.0:1783071285.013275:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446080 00000100:00100000:2.0:1783071285.013310:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071285.013319:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684446080:12345-0@lo:101: 00010000:00010000:2.0:1783071285.013334:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071285.013344:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec6ffe expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013367:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013377:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013385:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071285.013413:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684446080:12345-0@lo:101: Request processed in 95us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.013426:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071285.013470:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446080:0@lo:101: 00010000:00010000:2.0:1783071285.013483:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.013491:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.013539:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446208:0@lo:501: 00000100:00100000:2.0:1783071285.013562:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.013577:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.013588:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446208 00000100:00100000:2.0:1783071285.013591:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446208 00000100:00100000:2.0:1783071285.013610:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071285.013616:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684446208:12345-0@lo:501: 00000100:00100000:2.0:1783071285.016109:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684446208:12345-0@lo:501: Request processed in 2485us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.016123:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071285.016209:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446208:0@lo:501: 00000100:00100000:2.0:1783071285.016255:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446336:0@lo:503: 00000100:00100000:2.0:1783071285.016300:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.016331:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.016346:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446336 00000100:00100000:2.0:1783071285.016352:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446336 00000100:00100000:2.0:1783071285.016385:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071285.016393:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684446336:12345-0@lo:503: 00000100:00100000:2.0:1783071285.017620:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684446336:12345-0@lo:503: Request processed in 1224us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.017631:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071285.017733:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684446336:0@lo:503: 00000100:00100000:2.0:1783071285.022038:0:6677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6677:1869685684446464:0@lo:502: 00000100:00100000:2.0:1783071285.022118:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.022159:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446464 00000100:00100000:2.0:1783071285.022166:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446464 00000100:00100000:2.0:1783071285.022220:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071285.022229:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:6677:x1869685684446464:12345-0@lo:502: 00000100:00100000:2.0:1783071285.022561:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:6677:x1869685684446464:12345-0@lo:502: Request processed in 331us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.022571:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783071285.023731:0:6677:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.023762:0:6677:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6677:1869685684446464:0@lo:502: 00000020:01000000:2.0:1783071285.023797:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071285.023805:0:6677:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783071285.023892:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071285.023896:0:6677:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783071285.023903:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071285.023907:0:6677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1783071285.023932:0:6677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783071285.023936:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071285.023962:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9782fa303380) 00000020:00000080:2.0:1783071285.023981:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783071285.023987:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071285.024062:0:6677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783071285.024073:0:6677:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783071285.024079:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec7013 00010000:00080000:2.0:1783071285.024106:0:6677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9781c4990800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071285.024330:0:6677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783071285.053025:0:6677:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783071285.053050:0:6677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783071285.054283:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071285.054511:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071285.054563:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783071285.054621:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783071285.056127:0:6681:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071285.056138:0:6681:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783071285.057922:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783071285.057938:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783071285.057976:0:6677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783071285.057996:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec701a 00000100:00080000:0.0:1783071285.058006:0:6677:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071285.058013:0:6677:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9781c4990800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1783071285.058052:0:6677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782f9ed3100 x1869685684446592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783071285.058082:0:6677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783071285.058138:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071285.058141:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071285.058143:0:6677:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783071285.058146:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071285.058150:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071285.058151:0:6677:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783071285.058154:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783071285.058155:0:6677:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783071285.059281:0:6677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6677:1869685684446720:0@lo:502: 00000100:00100000:0.0:1783071285.059360:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071285.060096:0:6677:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071285.060252:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684446976:0@lo:400: 00000100:00100000:0.0:1783071285.060290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071285.060310:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071285.060315:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684446848:0@lo:400: 00000100:00100000:0.0:1783071285.060343:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071285.060368:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446976 00000100:00100000:2.0:1783071285.060505:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684446592:0@lo:8: 00000100:00100000:2.0:1783071285.060541:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.060574:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446720 00000100:00100000:2.0:1783071285.060580:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446720 00000100:00100000:2.0:1783071285.060619:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783071285.060628:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:6677:x1869685684446720:12345-0@lo:502: 00000100:00100000:2.0:1783071285.060876:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:6677:x1869685684446720:12345-0@lo:502: Request processed in 249us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.060885:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783071285.060904:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446976 00000100:00100000:0.0:1783071285.060938:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446848 00000100:00100000:0.0:1783071285.060941:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446848 00000100:00100000:2.0:1783071285.060942:0:6677:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6677:1869685684446720:0@lo:502: 00000100:00100000:0.0:1783071285.060952:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071285.060958:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684446976:12345-0@lo:400: 00000020:01000000:2.0:1783071285.060970:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071285.060976:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071285.060978:0:6677:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783071285.060983:0:6677:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1783071285.060992:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684446976:12345-0@lo:400: Request processed in 34us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.060998:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071285.061008:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071285.061013:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684446848:12345-0@lo:400: 00000100:00100000:0.0:1783071285.061036:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684446848:12345-0@lo:400: Request processed in 23us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.061041:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783071285.061057:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783071285.061078:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed1500 x1869685684446848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1783071285.061089:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:0.0:1783071285.061089:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684446848:0@lo:400: 00010000:00080000:0.0:1783071285.061099:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed3b80 x1869685684446976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071285.061105:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684446976:0@lo:400: 10000000:01000000:2.0:1783071285.061107:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071285.061115:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061133:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071285.061142:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071285.061145:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c8344000 from 1 10000000:01000000:2.0:1783071285.061147:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071285.061171:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061179:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061187:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.061200:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447104:0@lo:101: 00000100:00100000:2.0:1783071285.061227:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.061242:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.061255:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447104 00000100:00100000:2.0:1783071285.061258:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447104 00000100:00100000:2.0:1783071285.061278:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783071285.061284:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684447104:12345-0@lo:101: 00010000:00010000:2.0:1783071285.061292:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071285.061305:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7021 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061327:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061349:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.061358:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938000, rc 0) 00000100:00100000:2.0:1783071285.061386:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447104:12345-0@lo:101: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.061392:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783071285.061424:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447104:0@lo:101: 00010000:00010000:2.0:1783071285.061437:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071285.061451:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684446592 00000100:00100000:1.0:1783071285.061458:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684446592 00010000:00010000:2.0:1783071285.061463:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071285.061486:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071285.061493:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1869685684446592:12345-0@lo:8: 00000100:00100000:2.0:1783071285.061507:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447232:0@lo:501: 00010000:00080000:1.0:1783071285.061518:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00100000:2.0:1783071285.061534:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.061548:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326840 going to sleep for 11 seconds 00000020:00000080:1.0:1783071285.061548:0:6585:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec702f 00000100:00100000:2.0:1783071285.061566:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447232 00000100:00100000:2.0:1783071285.061571:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447232 00002000:00100000:1.0:1783071285.061592:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9781c4a0c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783071285.061597:0:6585:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:2.0:1783071285.061602:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000001:00000004:1.0:1783071285.061609:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783071285.061611:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447232:12345-0@lo:501: 00000100:00100000:2.0:1783071285.061855:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447232:12345-0@lo:501: Request processed in 245us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.061862:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00002000:00100000:1.0:1783071285.061874:0:6585:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783071285.061914:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447232:0@lo:501: 00000100:00100000:2.0:1783071285.061945:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447360:0@lo:503: 00000100:00100000:2.0:1783071285.061989:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.062026:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071285.062068:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447360 00000100:00100000:0.0:1783071285.062073:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447360 00000100:00100000:0.0:1783071285.062139:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783071285.062146:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447360:12345-0@lo:503: 00002000:00080000:1.0:1783071285.062287:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783071285.062316:0:6585:0:(import.c:65:import_set_state_nolock()) ffff9781c4a0a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071285.062386:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1869685684446592:12345-0@lo:8: Request processed in 891us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071285.062395:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071285.062498:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447360:12345-0@lo:503: Request processed in 351us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.062506:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783071285.062526:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447360:0@lo:503: 00010000:00080000:1.0:1783071285.062529:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed3100 x1869685684446592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071285.062541:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071285.062548:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783071285.062555:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783071285.062561:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783071285.062564:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c4990800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783071285.062581:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783071285.062587:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684446592:0@lo:8: 00000004:00080000:3.0:1783071285.062775:0:6681:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783071285.062853:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 186437178532ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783071285.064837:0:6683:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6683:1869685684447488:0@lo:502: 00000100:00100000:2.0:1783071285.064911:0:6683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.064956:0:6683:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa3266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071285.065071:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447488 00000100:00100000:0.0:1783071285.065078:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447488 00000100:00100000:0.0:1783071285.065125:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071285.065134:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:6683:x1869685684447488:12345-0@lo:502: 00000100:00100000:0.0:1783071285.065359:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:6683:x1869685684447488:12345-0@lo:502: Request processed in 225us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.065366:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071285.065971:0:6683:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6683:1869685684447488:0@lo:502: 00000020:01000000:2.0:1783071285.066001:0:6683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071285.066010:0:6683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071285.066012:0:6683:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783071285.066018:0:6683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c8344000 00000020:00000080:2.0:1783071285.066020:0:6683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783071285.066045:0:6683:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6683:1869685684447616:0@lo:502: 00000100:00100000:2.0:1783071285.066082:0:6683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.066129:0:6683:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa3266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071285.066602:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447616 00000100:00100000:1.0:1783071285.066608:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447616 00000100:00100000:1.0:1783071285.067435:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071285.067458:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:6683:x1869685684447616:12345-0@lo:502: 00000100:00100000:1.0:1783071285.067699:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:6683:x1869685684447616:12345-0@lo:502: Request processed in 243us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071285.067706:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783071285.067971:0:6683:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:6683:1869685684447616:0@lo:502: 00000020:01000000:0.0:1783071285.068001:0:6683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071285.068008:0:6683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071285.068009:0:6683:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783071285.068015:0:6683:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783071285.068074:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783071285.068091:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071285.068101:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.068125:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071285.068136:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783071285.068138:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9782c5bbb380 from 1 10000000:01000000:2.0:1783071285.068141:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783071285.068166:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.068185:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.068201:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.069065:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447744:0@lo:101: 00000100:00100000:2.0:1783071285.069118:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.069161:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071285.069401:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447744 00000100:00100000:3.0:1783071285.069409:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447744 00000100:00100000:3.0:1783071285.069468:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783071285.069485:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684447744:12345-0@lo:101: 00010000:00010000:3.0:1783071285.069499:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071285.069516:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7036 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071285.069543:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071285.069555:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071285.069564:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cfa00, rc 0) 00000100:00100000:3.0:1783071285.069610:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684447744:12345-0@lo:101: Request processed in 127us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071285.069616:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783071285.069723:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447744:0@lo:101: 00010000:00010000:2.0:1783071285.069737:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.069746:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071285.069797:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447872:0@lo:501: 00000100:00100000:2.0:1783071285.069822:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.069847:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071285.069922:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684447872 00000100:00100000:0.0:1783071285.069928:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684447872 00000100:00100000:0.0:1783071285.069963:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783071285.069970:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684447872:12345-0@lo:501: 00000100:00100000:0.0:1783071285.070190:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684447872:12345-0@lo:501: Request processed in 219us (365us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071285.070197:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071285.070465:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684447872:0@lo:501: 10000000:01000000:2.0:1783071285.070489:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071285.070496:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071285.070506:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071285.094593:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783071285.094909:0:6682:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783071285.094938:0:6682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c38000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448128:0@lo:7: 00000100:00100000:3.0:1783071285.095011:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071285.095053:0:6682:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071285.095076:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071285.095085:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684448000:0@lo:13: 00000100:00100000:3.0:1783071285.095114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071285.095152:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448128 00000100:00100000:3.0:1783071285.095159:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448128 00000100:00100000:3.0:1783071285.095212:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071285.095221:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6682:x1869685684448128:12345-0@lo:7: 00000100:00100000:0.0:1783071285.096749:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448000 00000100:00100000:0.0:1783071285.096757:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448000 00000100:00100000:0.0:1783071285.096797:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071285.096804:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684448000:12345-0@lo:13: 00002000:00000024:0.0:1783071285.096839:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783071285.096907:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684448000:12345-0@lo:13: Request processed in 103us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.096914:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783071285.097110:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1783071285.101921:0:6588:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1783071285.101930:0:6588:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783071285.102044:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6682:x1869685684448128:12345-0@lo:7: Request processed in 6818us (7027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071285.102056:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071285.102137:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c5c3b800 x1869685684448000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071285.102165:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684448000:0@lo:13: 00010000:00080000:2.0:1783071285.102497:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c5c38000 x1869685684448128/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071285.102508:0:6682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c38000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448128:0@lo:7: 00000004:00080000:2.0:1783071285.102520:0:6682:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783071285.102568:0:6682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448256:0@lo:5: 00000100:00100000:2.0:1783071285.102608:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.102666:0:6682:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa3263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071285.102894:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448256 00000100:00100000:0.0:1783071285.102903:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448256 00000100:00100000:0.0:1783071285.102950:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071285.102959:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6682:x1869685684448256:12345-0@lo:5: 00002000:00080000:0.0:1783071285.102987:0:6585:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783071285.102990:0:6585:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783071285.103292:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6682:x1869685684448256:12345-0@lo:5: Request processed in 333us (683us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783071285.103300:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783071285.103334:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c3e27480 x1869685684448256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071285.103346:0:6682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448256:0@lo:5: 00000004:00080000:0.0:1783071285.103355:0:6682:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783071285.103381:0:6682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448384:0@lo:700: 00000100:00100000:0.0:1783071285.103408:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071285.103430:0:6682:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c66e7000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071285.103739:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448384 00000100:00100000:2.0:1783071285.103746:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448384 00000100:00100000:2.0:1783071285.103782:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071285.103790:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6682:x1869685684448384:12345-0@lo:700: 00000100:00100000:2.0:1783071285.103833:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6594:1869685684448512:0@lo:700: 00000100:00100000:2.0:1783071285.103868:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071285.103888:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa326f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071285.104047:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448512 00000100:00100000:3.0:1783071285.104051:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448512 00000100:00100000:3.0:1783071285.104085:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071285.104092:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6594:x1869685684448512:12345-0@lo:700: 40000000:02000000:3.0:1783071285.162538:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1783071285.173152:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6594:x1869685684448512:12345-0@lo:700: Request processed in 69052us (69274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071285.173188:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783071285.173294:0:6594:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c3e24000 x1869685684448512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783071301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071285.173309:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6594:1869685684448512:0@lo:700: 40000000:02000000:2.0:1783071285.173323:0:6594:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1783071285.286097:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1783071285.286119:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783071285.292247:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6682:x1869685684448384:12345-0@lo:700: Request processed in 188447us (188827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071285.292263:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783071285.299581:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed3b80 x1869685684448384/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071301 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071285.299596:0:6682:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783071285.299626:0:6682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448384:0@lo:700: 00000004:02000040:0.0:1783071285.366179:0:6682:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1783071285.369331:0:6682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448640:0@lo:5: 00000100:00100000:0.0:1783071285.369408:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071285.369691:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448640 00000100:00100000:3.0:1783071285.369699:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448640 00000100:00100000:3.0:1783071285.369760:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783071285.369769:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6682:x1869685684448640:12345-0@lo:5: 00000100:00100000:0.0:1783071285.370978:0:6682:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c66e7a80 going to sleep for 11 seconds 00002000:00080000:2.0:1783071285.380322:0:6588:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783071285.380342:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1783071285.387266:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6682:x1869685684448640:12345-0@lo:5: Request processed in 17489us (17849us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783071285.387295:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783071285.387483:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed3b80 x1869685684448640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071301 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071285.387502:0:6682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6682:1869685684448640:0@lo:5: 00000004:00080000:0.0:1783071285.387519:0:6682:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1783071285.409037:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071286.432902:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071287.458419:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071288.481835:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071289.508670:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071289.792503:0:6956:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783071290.081182:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684449024:0@lo:400: 00000100:00100000:3.0:1783071290.081272:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684448768:0@lo:400: 00000100:00100000:0.0:1783071290.081315:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071290.081365:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684449152:0@lo:400: 00000100:00100000:3.0:1783071290.082727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071290.083005:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448768 00000100:00100000:2.0:1783071290.083024:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448768 00000100:00100000:0.0:1783071290.083510:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071290.083529:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684448896:0@lo:400: 00000100:00100000:0.0:1783071290.083577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071290.083623:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449024 00000100:00100000:0.0:1783071290.083629:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449024 00000100:00080000:3.0:1783071290.083720:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071290.083763:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684448896 00000100:00100000:0.0:1783071290.083767:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684448896 00000100:00100000:0.0:1783071290.083786:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071290.083794:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684449024:12345-0@lo:400: 00000100:00100000:3.0:1783071290.083856:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783071290.083856:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684449024:12345-0@lo:400: Request processed in 61us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071290.083870:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783071290.083870:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071290.083892:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071290.083900:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684448896:12345-0@lo:400: 00000100:00100000:0.0:1783071290.083934:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684448896:12345-0@lo:400: Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071290.083952:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783071290.084110:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed2a00 x1869685684448896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071290.084124:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684448896:0@lo:400: 00000100:00100000:2.0:1783071290.084207:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783071290.084214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071290.084220:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3295:x1869685684448768:12345-0@lo:400: 00000100:00100000:2.0:1783071290.084422:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3295:x1869685684448768:12345-0@lo:400: Request processed in 207us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071290.084429:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783071290.084466:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449152 00000100:00100000:2.0:1783071290.084471:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449152 00000100:00100000:2.0:1783071290.084509:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071290.084516:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684449152:12345-0@lo:400: 00000100:00100000:2.0:1783071290.084563:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684449152:12345-0@lo:400: Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071290.084570:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783071290.085201:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684448768:0@lo:400: 00010000:00080000:2.0:1783071290.085666:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed1c00 x1869685684449152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071290.085696:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684449152:0@lo:400: 00000100:00080000:2.0:1783071290.086252:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071290.088443:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782f9ed1880 x1869685684449024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071290.088462:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684449024:0@lo:400: 00010000:00010000:0.0:1783071290.529435:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071290.597624:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684449280:0@lo:13: 00000100:00100000:3.0:1783071290.597715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071290.597792:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449280 00000100:00100000:3.0:1783071290.597815:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449280 00000100:00100000:3.0:1783071290.597876:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071290.597885:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684449280:12345-0@lo:13: 00002000:00000024:3.0:1783071290.597919:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071290.597965:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684449280:12345-0@lo:13: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071290.597971:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071290.598270:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c5c3b800 x1869685684449280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071290.598291:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684449280:0@lo:13: 00000001:00080000:1.0:1783071290.691322:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1783071291.552869:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071292.577441:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071293.600883:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071294.627653:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071295.201032:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071295.205419:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684449536:0@lo:400: 00000100:00100000:0.0:1783071295.205498:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071295.205566:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684449408:0@lo:400: 00000100:00100000:0.0:1783071295.205594:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071295.205660:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449408 00000100:00100000:3.0:1783071295.205670:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449408 00000100:00100000:3.0:1783071295.205753:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783071295.205763:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3293:x1869685684449408:12345-0@lo:400: 00000100:00100000:1.0:1783071295.205809:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449536 00000100:00100000:1.0:1783071295.205815:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449536 00000100:00100000:3.0:1783071295.205819:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3293:x1869685684449408:12345-0@lo:400: Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071295.205825:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783071295.205851:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071295.205861:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684449536:12345-0@lo:400: 00000100:00100000:1.0:1783071295.205896:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684449536:12345-0@lo:400: Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071295.205902:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783071295.206664:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c3e26d80 x1869685684449536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071295.206706:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684449536:0@lo:400: 00000100:00100000:0.0:1783071295.206718:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684449408:0@lo:400: 00000100:00100000:0.0:1783071295.207659:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684449792:0@lo:400: 00000100:00100000:0.0:1783071295.207720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071295.207761:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071295.207767:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684449664:0@lo:400: 00000100:00100000:0.0:1783071295.207790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071295.207871:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449792 00000100:00100000:2.0:1783071295.207877:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449792 00000100:00100000:2.0:1783071295.207936:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071295.207944:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684449792:12345-0@lo:400: 00000100:00100000:2.0:1783071295.207989:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684449792:12345-0@lo:400: Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071295.208002:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783071295.208023:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071295.208205:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c3e24a80 x1869685684449792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071295.208213:0:3295:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783071295.208224:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684449792:0@lo:400: 00000100:00100000:1.0:1783071295.208650:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449664 00000100:00100000:1.0:1783071295.208655:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449664 00000100:00100000:1.0:1783071295.208872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071295.208880:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684449664:12345-0@lo:400: 00000100:00100000:1.0:1783071295.208948:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684449664:12345-0@lo:400: Request processed in 69us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071295.208954:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783071295.209086:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c3e27100 x1869685684449664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071295.209097:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684449664:0@lo:400: 00000100:00080000:2.0:1783071295.209214:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783071295.652519:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071295.713173:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684449920:0@lo:13: 00000100:00100000:1.0:1783071295.713246:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071295.713322:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684449920 00000100:00100000:1.0:1783071295.713331:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684449920 00000100:00100000:1.0:1783071295.713393:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071295.713405:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684449920:12345-0@lo:13: 00002000:00000024:1.0:1783071295.713440:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071295.713494:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684449920:12345-0@lo:13: Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071295.713511:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071295.713744:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782c824f100 x1869685684449920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071295.713764:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684449920:0@lo:13: 00010000:00010000:2.0:1783071296.675468:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783071297.566502:0:7476:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783071297.566507:0:7476:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783071297.566669:0:7476:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9782c7f0f800 00000020:01000004:2.0:1783071297.566718:0:7476:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783071297.566731:0:7476:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783071297.566744:0:7476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9782fa304d40) 00000020:00000080:2.0:1783071297.566761:0:7476:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783071297.580802:0:7476:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783071297.581063:0:7476:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783071297.599125:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1783071297.604153:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783071297.604187:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1783071297.604243:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783071297.604269:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1783071297.604781:0:7476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783071297.604797:0:7476:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783071297.604813:0:7476:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd360fc6ce6ec704b 00000020:01000004:1.0:1783071297.604821:0:7476:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783071297.604843:0:7476:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783071297.604847:0:7476:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783071297.604852:0:7476:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783071297.604876:0:7476:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783071297.604881:0:7476:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783071297.622253:0:7476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783071297.622291:0:7476:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783071297.622295:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783071297.622297:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071297.622298:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071297.622299:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071297.622301:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071297.622302:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071297.622304:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071297.622305:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071297.622306:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071297.622308:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071297.622309:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783071297.622313:0:7476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783071297.622315:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783071297.622320:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071297.622322:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071297.622323:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071297.622324:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071297.622325:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071297.622326:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071297.622327:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071297.622328:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071297.622329:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071297.622330:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783071297.622365:0:7476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783071297.622385:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684450048:0@lo:253: 00000100:00100000:1.0:1783071297.622471:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.622775:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071297.622867:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450048 00000100:00100000:2.0:1783071297.622875:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450048 00000100:00100000:2.0:1783071297.622967:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783071297.622977:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:7476:x1869685684450048:12345-0@lo:253: 20000000:01000000:2.0:1783071297.623008:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783071297.623012:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783071297.623018:0:5785:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783071297.623021:0:5785:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783071297.624120:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071297.624371:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783071297.624386:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1783071297.624430:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783071297.624438:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1783071297.624467:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783071297.624731:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783071297.625096:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783071297.625117:0:5785:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:2.0:1783071297.625119:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:2.0:1783071297.625156:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783071297.625165:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783071297.625213:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783071297.625221:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:2.0:1783071297.625249:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783071297.625257:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783071297.625295:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783071297.625354:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783071297.626817:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1783071297.626841:0:5785:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.116@tcp 20000000:01000000:2.0:1783071297.626843:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.116@tcp (null) (null) (null) 00000040:00080000:2.0:1783071297.626880:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1783071297.626888:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783071297.626918:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1783071297.626925:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.116@tcp (null) (null) 00000040:00080000:2.0:1783071297.626951:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1783071297.626959:0:5785:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783071297.627000:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1783071297.627033:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1783071297.627047:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783071297.627050:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783071297.627053:0:5785:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783071297.627065:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783071297.627068:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783071297.627101:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783071297.627103:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783071297.627752:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1783071297.627803:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1783071297.627857:0:7478:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783071297.628129:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783071297.628166:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783071297.628222:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1783071297.628232:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783071297.628234:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783071297.628900:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783071297.629112:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783071297.629151:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783071297.629206:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783071297.629218:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783071297.629220:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783071297.629978:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1783071297.630045:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1783071297.630081:0:7480:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1783071297.630307:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1783071297.630351:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1783071297.630415:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1783071297.630426:0:5785:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783071297.630427:0:5785:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783071297.631194:0:7481:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1783071297.631245:0:7481:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1783071297.631296:0:7481:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783071297.631853:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1783071297.631891:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1783071297.631918:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1783071297.631930:0:5785:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783071297.631932:0:5785:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783071297.631940:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783071297.631956:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.631974:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.631982:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.631990:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.631997:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632015:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632022:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632059:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632072:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 16 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.632084:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450176:0@lo:104: 00000100:00100000:2.0:1783071297.632157:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071297.632248:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632257:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.632265:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450304:0@lo:104: 00010000:00010000:2.0:1783071297.632284:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632292:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 16 pid: 5783 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.632299:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450432:0@lo:104: 00010000:00010000:2.0:1783071297.632314:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632327:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.632335:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450560:0@lo:104: 00010000:00010000:2.0:1783071297.632367:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.632374:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.632382:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450688:0@lo:104: 00000100:00100000:2.0:1783071297.632395:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.632447:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783071297.632463:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.632647:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.632878:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.632896:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450176 00000100:00100000:2.0:1783071297.632903:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450176 00000100:00100000:2.0:1783071297.632934:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450304 00000100:00100000:2.0:1783071297.632936:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450304 00000100:00100000:2.0:1783071297.632943:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450432 00000100:00100000:2.0:1783071297.632945:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450432 00000100:00100000:2.0:1783071297.632956:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071297.632962:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782cd322c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5785:x1869685684450176:12345-0@lo:104: 00010000:00010000:2.0:1783071297.632974:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.633062:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071297.633068:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782cd322c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5785:x1869685684450176:12345-0@lo:104: Request processed in 105us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.633074:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071297.633110:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071297.633122:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5785:x1869685684450304:12345-0@lo:104: 00010000:00010000:2.0:1783071297.633130:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071297.633197:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450176:0@lo:104: 00000100:00100000:0.0:1783071297.633204:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450304:0@lo:104: 00010000:00010000:1.0:1783071297.633230:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071297.633237:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633245:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938600 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071297.633249:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633258:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071297.633265:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071297.633270:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071297.633303:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633319:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071297.633337:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633355:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938600/0xd360fc6ce6ec7036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec703d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633368:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071297.633371:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633377:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071297.633380:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633387:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071297.633392:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071297.633397:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783071297.633408:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633414:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071297.633426:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633432:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec6ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7005 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.633446:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071297.633447:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071297.633450:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071297.633460:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684450816:0@lo:103: 00000100:00100000:1.0:1783071297.633488:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.633546:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071297.633554:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684450944:0@lo:103: 00000100:00100000:1.0:1783071297.633576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.633872:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.633880:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783071297.633886:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1783071297.634069:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450560 00000100:00100000:3.0:1783071297.634075:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450560 00000100:00100000:3.0:1783071297.634110:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783071297.634115:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450688 00000100:00100000:3.0:1783071297.634118:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450688 00000100:00100000:3.0:1783071297.634157:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450816 00000100:00100000:3.0:1783071297.634160:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450816 00010000:00010000:3.0:1783071297.634174:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 17 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.634238:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783071297.634245:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:5785:x1869685684450304:12345-0@lo:104: Request processed in 1123us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.634252:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071297.634268:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071297.634274:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5785:x1869685684450432:12345-0@lo:104: 00010000:00010000:2.0:1783071297.634282:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.634325:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071297.634330:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:5785:x1869685684450432:12345-0@lo:104: Request processed in 57us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.634336:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783071297.634359:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071297.634365:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5785:x1869685684450560:12345-0@lo:104: 00010000:00010000:2.0:1783071297.634371:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.634396:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071297.634401:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:5785:x1869685684450560:12345-0@lo:104: Request processed in 37us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.634406:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071297.634420:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071297.634432:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5785:x1869685684450688:12345-0@lo:104: 00010000:00010000:2.0:1783071297.634439:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.634466:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783071297.634471:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5785:x1869685684450688:12345-0@lo:104: Request processed in 39us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.634476:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071297.634525:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684450944 00000100:00100000:3.0:1783071297.634529:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684450944 00010000:00010000:3.0:1783071297.634550:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 18 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071297.634879:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071297.634888:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:3293:x1869685684450816:12345-0@lo:103: 00010000:00010000:0.0:1783071297.634898:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071297.634904:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 18 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.634915:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 18 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.634930:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec703d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7036 expref: 18 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.634953:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071297.634990:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:3293:x1869685684450816:12345-0@lo:103: Request processed in 103us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.634996:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071297.635009:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071297.635015:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3295:x1869685684450944:12345-0@lo:103: 00010000:00010000:0.0:1783071297.635022:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071297.635025:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.635034:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.635043:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec7005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ffe expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.635052:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071297.635079:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3295:x1869685684450944:12345-0@lo:103: Request processed in 64us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.635085:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071297.635119:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684450944:0@lo:103: 00000100:00100000:1.0:1783071297.635184:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684450816:0@lo:103: 00010000:00010000:2.0:1783071297.635253:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783071297.635259:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635266:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6200 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071297.635270:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635278:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071297.635284:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071297.635289:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071297.635322:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635328:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071297.635358:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635376:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec6fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fe9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635387:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071297.635390:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635396:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071297.635400:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635407:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071297.635413:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071297.635417:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071297.635430:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635436:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071297.635445:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635452:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff97830217c400/0xd360fc6ce6ec6fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fbf expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635461:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071297.635469:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635475:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071297.635478:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.635486:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071297.635493:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071297.635498:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783071297.635642:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684451072:0@lo:103: 00000100:00100000:1.0:1783071297.635700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.635830:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451072 00000100:00100000:0.0:1783071297.635835:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451072 00010000:00010000:0.0:1783071297.635853:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 15 pid: 5783 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071297.635881:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071297.635889:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3295:x1869685684451072:12345-0@lo:103: 00010000:00010000:0.0:1783071297.635903:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071297.635908:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 15 pid: 5783 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.635917:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 15 pid: 5783 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.635928:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071297.635955:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3295:x1869685684451072:12345-0@lo:103: Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.635961:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071297.635988:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684451072:0@lo:103: 00010000:00010000:2.0:1783071297.636078:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636085:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071297.636091:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636098:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec6f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6f95 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636111:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071297.636113:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071297.636115:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071297.636121:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071297.636131:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684451328:0@lo:103: 00000100:00100000:2.0:1783071297.636156:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.636188:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071297.636201:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684451200:0@lo:103: 00000100:00100000:2.0:1783071297.636221:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.636244:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451328 00000100:00100000:2.0:1783071297.636247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451328 00010000:00010000:2.0:1783071297.636261:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 15 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.636272:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451200 00000100:00100000:2.0:1783071297.636275:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451200 00010000:00010000:2.0:1783071297.636284:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.636294:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071297.636299:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3293:x1869685684451328:12345-0@lo:103: 00010000:00010000:2.0:1783071297.636306:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071297.636310:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636317:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 16 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636325:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071297.636360:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3293:x1869685684451328:12345-0@lo:103: Request processed in 60us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.636366:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071297.636378:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071297.636384:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3293:x1869685684451200:12345-0@lo:103: 00010000:00010000:2.0:1783071297.636391:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071297.636395:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 15 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636409:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 15 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636421:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636430:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636443:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636450:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636457:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636463:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636467:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071297.636471:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636478:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636486:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636736:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071297.636762:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3293:x1869685684451200:12345-0@lo:103: Request processed in 378us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.636769:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071297.636794:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684451200:0@lo:103: 00000100:00100000:2.0:1783071297.636801:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684451328:0@lo:103: 00010000:00010000:2.0:1783071297.636828:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec6fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fe2 expref: 14 pid: 5783 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.636839:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450432:0@lo:104: 00010000:00010000:2.0:1783071297.636848:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec6fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6fb8 expref: 13 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.636857:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450560:0@lo:104: 00010000:00010000:2.0:1783071297.636866:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217ce00/0xd360fc6ce6ec6f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6f8e expref: 12 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.636874:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5785:1869685684450688:0@lo:104: 00010000:00010000:2.0:1783071297.636894:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636903:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636909:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.636927:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7052 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071297.636940:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783071297.683025:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:7476:x1869685684450048:12345-0@lo:253: Request processed in 60039us (60549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.683042:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783071297.683150:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684450048:0@lo:253: 10000000:01000000:1.0:1783071297.683165:0:7476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783071297.683168:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783071297.683170:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071297.683171:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071297.683173:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783071297.683174:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071297.683175:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071297.683177:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071297.683178:0:7476:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783071297.683180:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071297.683181:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783071297.683201:0:7476:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9782c7f0f800 from lustre-OST0001 10000000:01000000:1.0:1783071297.683224:0:7476:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783071297.683227:0:7476:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071297.683235:0:7476:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9782c5bbb380 local copy 10000000:01000000:1.0:1783071297.683239:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783071297.683291:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.683302:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.683311:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071297.683328:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451456:0@lo:101: 00000100:00100000:1.0:1783071297.683374:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.683445:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071297.683671:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451456 00000100:00100000:2.0:1783071297.683694:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451456 00000100:00100000:2.0:1783071297.683771:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071297.683781:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:7476:x1869685684451456:12345-0@lo:101: 00010000:00010000:2.0:1783071297.683793:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071297.683806:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7059 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.683827:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7059 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.683838:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7059 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.683847:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:2.0:1783071297.683888:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684451456:12345-0@lo:101: Request processed in 109us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.683895:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783071297.683954:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451456:0@lo:101: 00010000:00010000:1.0:1783071297.683966:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.683975:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071297.684085:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451584:0@lo:501: 00000100:00100000:1.0:1783071297.684110:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.684185:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.684266:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451584 00000100:00100000:3.0:1783071297.684270:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451584 00000100:00100000:3.0:1783071297.684288:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783071297.684294:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684451584:12345-0@lo:501: 00000100:00100000:3.0:1783071297.684507:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684451584:12345-0@lo:501: Request processed in 205us (388us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071297.684520:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783071297.684647:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451584:0@lo:501: 10000000:01000000:1.0:1783071297.684662:0:7476:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783071297.684704:0:7476:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783071297.684709:0:7476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.684717:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.684730:0:7476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.684753:0:7476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783071297.684772:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9782c7f0f800 10000000:01000000:1.0:1783071297.684776:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783071297.684781:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071297.684784:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071297.684788:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783071297.684790:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071297.684806:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.684813:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.684820:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071297.684832:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451712:0@lo:101: 00000100:00100000:1.0:1783071297.684856:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.684868:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976f00 going to sleep for 11 seconds 00010000:00010000:3.0:1783071297.685053:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071297.685060:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685067:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071297.685070:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685079:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071297.685096:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071297.685102:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071297.685119:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685125:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071297.685144:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685152:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d7000/0xd360fc6ce6ec7059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd360fc6ce6ec7060 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685164:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071297.685166:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071297.685168:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071297.685177:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451712 00000100:00100000:3.0:1783071297.685181:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451712 00000100:00100000:3.0:1783071297.685201:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783071297.685206:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684451712:12345-0@lo:101: 00010000:00010000:3.0:1783071297.685214:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071297.685223:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7067 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685238:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685246:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.685259:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cf200, rc 0) 00000100:00100000:3.0:1783071297.685286:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684451712:12345-0@lo:101: Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.685292:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783071297.685369:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451712:0@lo:101: 00010000:00010000:1.0:1783071297.685379:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.685386:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071297.685452:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451968:0@lo:501: 00000100:00100000:1.0:1783071297.685475:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.685517:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.685797:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451968 00000100:00100000:3.0:1783071297.685802:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451968 00000100:00100000:3.0:1783071297.685820:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783071297.685826:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684451968:12345-0@lo:501: 00000100:00100000:3.0:1783071297.685994:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684451968:12345-0@lo:501: Request processed in 167us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.686001:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783071297.686079:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684451968:0@lo:501: 00000100:00100000:1.0:1783071297.686106:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452096:0@lo:503: 00000100:00100000:1.0:1783071297.686142:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.686167:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.686209:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452096 00000100:00100000:3.0:1783071297.686213:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452096 00000100:00100000:3.0:1783071297.686229:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071297.686234:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452096:12345-0@lo:503: 00000100:00100000:3.0:1783071297.686378:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452096:12345-0@lo:503: Request processed in 143us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.686384:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783071297.686487:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452096:0@lo:503: 00000040:00080000:1.0:1783071297.686761:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071297.686815:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452224:0@lo:502: 00000100:00100000:1.0:1783071297.686846:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.686861:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.686994:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452224 00000100:00100000:3.0:1783071297.686999:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452224 00000100:00100000:3.0:1783071297.687017:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071297.687023:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452224:12345-0@lo:502: 00000100:00100000:3.0:1783071297.687147:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452224:12345-0@lo:502: Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.687154:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783071297.687286:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452224:0@lo:502: 00000100:00100000:2.0:1783071297.687416:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684451840:0@lo:103: 00000100:00100000:2.0:1783071297.687448:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.687658:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684451840 00000100:00100000:3.0:1783071297.687667:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684451840 00000100:00100000:3.0:1783071297.687724:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071297.687731:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3294:x1869685684451840:12345-0@lo:103: 00010000:00010000:3.0:1783071297.687742:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071297.687761:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec7059 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.687774:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071297.687801:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3294:x1869685684451840:12345-0@lo:103: Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.687807:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071297.687868:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684451840:0@lo:103: 00000040:00080000:1.0:1783071297.687887:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783071297.687929:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783071297.687947:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783071297.687981:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783071297.688016:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783071297.688052:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783071297.688075:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452352:0@lo:502: 00000100:00100000:1.0:1783071297.688108:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.688132:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.688176:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452352 00000100:00100000:3.0:1783071297.688180:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452352 00000100:00100000:3.0:1783071297.688210:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071297.688217:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684452352:12345-0@lo:502: 00000100:00100000:3.0:1783071297.688338:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684452352:12345-0@lo:502: Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.688351:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783071297.688406:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452352:0@lo:502: 00000040:00080000:1.0:1783071297.688461:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783071297.688473:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783071297.689010:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783071297.689017:0:7483:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783071297.689023:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071297.689025:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783071297.689030:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071297.689043:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9782f9ec3380) 00000020:00000080:3.0:1783071297.689063:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783071297.689068:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783071297.689119:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c7f0f800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783071297.689126:0:7483:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783071297.689132:0:7483:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd360fc6ce6ec707c 00010000:00010000:2.0:1783071297.692850:0:7483:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1783071297.693134:0:7483:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00010000:00010000:0.0:1783071297.696822:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783071297.697829:0:7483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783071297.698113:0:7483:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783071297.702898:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783071297.703392:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783071297.710525:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783071297.710721:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071297.710729:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071297.710731:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783071297.710736:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071297.710740:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071297.710742:0:7483:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783071297.710746:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783071297.710748:0:7483:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783071297.710808:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071297.710812:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071297.710813:0:7483:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783071297.710816:0:7483:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783071297.711090:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783071297.711118:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783071297.711141:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.711153:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071297.711160:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0f800 from 1 10000000:01000000:2.0:1783071297.711163:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071297.711197:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.711205:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.711217:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.711239:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452480:0@lo:101: 00000100:00100000:2.0:1783071297.711311:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.711411:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.713978:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452480 00000100:00100000:3.0:1783071297.713997:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452480 00000100:00100000:2.0:1783071297.714122:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071297.714132:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:7476:x1869685684452480:12345-0@lo:101: 00010000:00010000:2.0:1783071297.714149:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071297.714173:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7083 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.714203:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.714216:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071297.714226:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938e00, rc 0) 00000100:00100000:2.0:1783071297.714311:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452480:12345-0@lo:101: Request processed in 181us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.714319:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783071297.714709:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452480:0@lo:101: 00010000:00010000:1.0:1783071297.714729:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.714739:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071297.714846:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452608:0@lo:501: 00000100:00100000:1.0:1783071297.714884:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.714921:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa9763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.714998:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452608 00000100:00100000:3.0:1783071297.715002:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452608 00000100:00100000:3.0:1783071297.715036:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783071297.715043:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452608:12345-0@lo:501: 00000100:00100000:3.0:1783071297.715273:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452608:12345-0@lo:501: Request processed in 229us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.715280:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783071297.715397:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452608:0@lo:501: 00000100:00100000:1.0:1783071297.715424:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452736:0@lo:503: 00000100:00100000:1.0:1783071297.715459:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.715481:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa9763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.715809:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452736 00000100:00100000:3.0:1783071297.715815:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452736 00000100:00100000:3.0:1783071297.715852:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783071297.715859:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452736:12345-0@lo:503: 00000100:00100000:3.0:1783071297.716173:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452736:12345-0@lo:503: Request processed in 314us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.716181:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783071297.719847:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452736:0@lo:503: 00000040:00080000:2.0:1783071297.720184:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071297.720293:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452864:0@lo:502: 00000100:00100000:2.0:1783071297.720380:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.720472:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af4300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.722335:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452864 00000100:00100000:3.0:1783071297.722356:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452864 00000100:00100000:2.0:1783071297.723032:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783071297.723045:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452864:12345-0@lo:502: 00000100:00100000:2.0:1783071297.723326:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452864:12345-0@lo:502: Request processed in 283us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.723335:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783071297.723493:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452864:0@lo:502: 00000040:00080000:1.0:1783071297.723872:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783071297.723930:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783071297.723968:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452992:0@lo:502: 00000100:00100000:1.0:1783071297.724015:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.724042:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa9766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.724211:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684452992 00000100:00100000:3.0:1783071297.724217:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684452992 00000100:00100000:3.0:1783071297.724264:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783071297.724272:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452992:12345-0@lo:502: 00000100:00100000:3.0:1783071297.724419:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684452992:12345-0@lo:502: Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.724425:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071297.724829:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684452992:0@lo:502: 00000040:00080000:1.0:1783071297.724916:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783071297.724927:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783071297.725373:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071297.725382:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071297.725385:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783071297.725402:0:7487:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c7f0f800 00000020:00000080:1.0:1783071297.725405:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783071297.725428:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071297.725431:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071297.725433:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783071297.725436:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783071297.725702:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783071297.725722:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071297.725739:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.725760:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071297.725797:0:7476:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783071297.725800:0:7476:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9782c7f0f800 10000000:01000000:3.0:1783071297.725803:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9782c7f0f800 10000000:01000000:3.0:1783071297.725807:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071297.725812:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c7f0f800 from 1 10000000:01000000:3.0:1783071297.725814:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071297.725842:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.725849:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.725857:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071297.725873:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453120:0@lo:101: 00000100:00100000:3.0:1783071297.725917:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.725946:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c62b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.725963:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453120 00000100:00100000:3.0:1783071297.725969:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453120 00000100:00100000:3.0:1783071297.725998:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783071297.726005:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684453120:12345-0@lo:101: 00010000:00010000:3.0:1783071297.726015:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071297.726026:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7091 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.726057:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.726067:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.726075:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cfa00, rc 0) 00000100:00100000:3.0:1783071297.726108:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453120:12345-0@lo:101: Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.726114:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783071297.726153:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453120:0@lo:101: 00010000:00010000:3.0:1783071297.726166:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.726174:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071297.726239:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453248:0@lo:501: 00000100:00100000:3.0:1783071297.726262:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.726276:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c62b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.726289:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453248 00000100:00100000:3.0:1783071297.726292:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453248 00000100:00100000:3.0:1783071297.726309:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783071297.726315:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453248:12345-0@lo:501: 00000100:00100000:3.0:1783071297.726734:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453248:12345-0@lo:501: Request processed in 417us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.726741:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783071297.726778:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453248:0@lo:501: 00000100:00100000:3.0:1783071297.726803:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453376:0@lo:503: 00000100:00100000:3.0:1783071297.726836:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.726849:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c62b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.726862:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453376 00000100:00100000:3.0:1783071297.726866:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453376 00000100:00100000:3.0:1783071297.726883:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071297.726889:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453376:12345-0@lo:503: 00000100:00100000:3.0:1783071297.727019:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453376:12345-0@lo:503: Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.727026:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783071297.727059:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453376:0@lo:503: 00000040:00080000:3.0:1783071297.727303:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783071297.727371:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453504:0@lo:502: 00000100:00100000:3.0:1783071297.727402:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.727416:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c62b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.727428:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453504 00000100:00100000:3.0:1783071297.727431:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453504 00000100:00100000:3.0:1783071297.727448:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783071297.727454:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453504:12345-0@lo:502: 00000100:00100000:3.0:1783071297.728031:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453504:12345-0@lo:502: Request processed in 575us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.728039:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783071297.728198:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453504:0@lo:502: 00000040:00080000:0.0:1783071297.728465:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783071297.728785:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783071297.728826:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783071297.728887:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783071297.728926:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783071297.728977:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783071297.729014:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783071297.729045:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783071297.729090:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783071297.729120:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783071297.729153:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783071297.729200:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783071297.729237:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783071297.729288:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783071297.729351:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783071297.729391:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783071297.729427:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783071297.729477:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783071297.729826:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783071297.729867:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783071297.729934:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783071297.729971:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783071297.730006:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783071297.730067:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783071297.730105:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783071297.730140:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783071297.730187:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783071297.730223:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783071297.730255:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783071297.730318:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783071297.730364:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783071297.730395:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783071297.730423:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783071297.730465:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783071297.730494:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783071297.730829:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783071297.730876:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783071297.730916:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453632:0@lo:502: 00000100:00100000:0.0:1783071297.730984:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.731062:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b7bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071297.731104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453632 00000100:00100000:1.0:1783071297.731110:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453632 00000100:00100000:1.0:1783071297.731202:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783071297.731212:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453632:12345-0@lo:502: 00000100:00100000:1.0:1783071297.731468:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684453632:12345-0@lo:502: Request processed in 257us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071297.731476:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783071297.731761:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684453632:0@lo:502: 00000040:00080000:0.0:1783071297.731833:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1783071297.731843:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783071297.732849:0:7488:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783071297.732864:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9782fa3019c0) 00000020:00000080:2.0:1783071297.732885:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783071297.733031:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c7f0f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783071297.733035:0:7488:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c7f0f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783071297.733045:0:7488:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c7f0f800 3 00010000:00080000:2.0:1783071297.733083:0:7488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9781c6ce4800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071297.736981:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783071297.737074:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783071297.737109:0:7488:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783071297.737120:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd360fc6ce6ec70a6 00000100:00080000:2.0:1783071297.737129:0:7488:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071297.737135:0:7488:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9781c6ce4800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1783071297.737164:0:7488:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782c3e27100 x1869685684453760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783071297.737189:0:7488:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783071297.737635:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684453760:0@lo:38: 00000100:00100000:1.0:1783071297.737723:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071297.737888:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453760 00000100:00100000:2.0:1783071297.737894:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453760 00000100:00100000:2.0:1783071297.737929:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071297.737935:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1869685684453760:12345-0@lo:38: 00010000:00080000:2.0:1783071297.737957:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1783071297.737998:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd360fc6ce6ec70ad 00000004:00100000:2.0:1783071297.738013:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071297.738048:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9781c5c53800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071297.738099:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869685684453760:12345-0@lo:38: Request processed in 163us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.738106:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071297.738248:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071297.738258:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684453888:0@lo:400: 00000100:00100000:0.0:1783071297.738287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.738313:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684454016:0@lo:400: 00000100:00100000:0.0:1783071297.738335:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.738366:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071297.738372:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684454144:0@lo:400: 00000100:00100000:0.0:1783071297.738397:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.738425:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684453888 00000100:00100000:0.0:1783071297.738429:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684453888 00000100:00100000:0.0:1783071297.738457:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454016 00000100:00100000:0.0:1783071297.738460:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454016 00000100:00100000:0.0:1783071297.738485:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071297.738491:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684453888:12345-0@lo:400: 00000100:00100000:0.0:1783071297.738656:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684453888:12345-0@lo:400: Request processed in 164us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.738662:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071297.738895:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071297.738903:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684454016:12345-0@lo:400: 00000100:00100000:0.0:1783071297.738933:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684454016:12345-0@lo:400: Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.738945:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071297.738964:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454144 00000100:00100000:0.0:1783071297.738968:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454144 00000100:00100000:0.0:1783071297.738995:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071297.739000:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684454144:12345-0@lo:400: 00000100:00100000:0.0:1783071297.739027:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684454144:12345-0@lo:400: Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071297.739032:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783071297.739045:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071297.739048:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783071297.739071:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9ed3b80 x1869685684453888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071297.739085:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684453888:0@lo:400: 00010000:00080000:0.0:1783071297.739111:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9ed0380 x1869685684454144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071297.739121:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684454144:0@lo:400: 00010000:00080000:0.0:1783071297.739130:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9ed1f80 x1869685684454016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071297.739137:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684454016:0@lo:400: 00010000:00080000:1.0:1783071297.739398:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e27100 x1869685684453760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071297.739407:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783071297.739414:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783071297.739421:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783071297.739425:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783071297.739428:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c6ce4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783071297.739434:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684453760:0@lo:38: 00000040:00080000:2.0:1783071297.740980:0:7488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1783071297.741180:0:7490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1869685684454272:0@lo:901: 00000100:00100000:1.0:1783071297.741238:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.741272:0:7490:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071297.741727:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454272 00000100:00100000:2.0:1783071297.741735:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454272 00000100:00100000:2.0:1783071297.741787:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071297.741795:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1869685684454272:12345-0@lo:901: 00000100:00100000:2.0:1783071297.742182:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1869685684454272:12345-0@lo:901: Request processed in 387us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.742196:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783071297.742268:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783071297.742299:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824d880 x1869685684454272/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783071313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071297.742311:0:7490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1869685684454272:0@lo:901: 00000020:01000000:1.0:1783071297.742729:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1783071297.742756:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783071297.742774:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071297.742786:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783071297.742837:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783071297.742840:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071297.742841:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071297.742842:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071297.742844:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071297.742845:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071297.742847:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071297.742849:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071297.742850:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071297.742852:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071297.742853:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783071297.742857:0:7476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783071297.742860:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783071297.742861:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783071297.742862:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783071297.742863:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783071297.742864:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783071297.742865:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783071297.742866:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783071297.742867:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783071297.742868:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783071297.742869:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783071297.742870:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783071297.742889:0:7476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783071297.742906:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684454400:0@lo:253: 00000100:00100000:1.0:1783071297.742955:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071297.742983:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071297.743739:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454400 00000100:00100000:2.0:1783071297.743747:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454400 00000100:00100000:2.0:1783071297.743787:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783071297.743794:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:7476:x1869685684454400:12345-0@lo:253: 20000000:01000000:2.0:1783071297.743820:0:5783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783071297.743833:0:5783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783071297.775436:0:5783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783071297.775447:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783071297.775543:0:5807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783071297.775548:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071297.775570:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.775588:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.775618:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.775656:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.775669:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 14 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071297.775699:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684454528:0@lo:104: 00000100:00100000:0.0:1783071297.775763:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071297.775801:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071297.776145:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454528 00000100:00100000:3.0:1783071297.776153:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454528 00000100:00100000:3.0:1783071297.776203:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071297.776212:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684454528:12345-0@lo:104: 00010000:00010000:3.0:1783071297.776232:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.776292:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071297.776299:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:5807:x1869685684454528:12345-0@lo:104: Request processed in 88us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.776306:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1783071297.776331:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071297.776337:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071297.776489:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5807:1869685684454528:0@lo:104: 00010000:00010000:0.0:1783071297.776526:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777017:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071297.777022:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777030:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071297.777037:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071297.777042:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071297.777078:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777085:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071297.777099:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777105:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec6ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6ff7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777133:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071297.777135:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071297.777137:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071297.777177:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071297.777191:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684454656:0@lo:103: 00000100:00100000:2.0:1783071297.777236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071297.777354:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454656 00000100:00100000:3.0:1783071297.777360:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454656 00010000:00010000:3.0:1783071297.777382:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 15 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071297.777410:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071297.777416:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c6259450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3295:x1869685684454656:12345-0@lo:103: 00010000:00010000:3.0:1783071297.777427:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071297.777431:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 15 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777441:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 15 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777454:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec6ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6ff0 expref: 15 pid: 5784 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777468:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777476:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783071297.777490:0:5776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001941977s 00010000:00010000:3.0:1783071297.777495:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777847:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777854:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777860:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777866:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071297.777870:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777877:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777896:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071297.777905:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071297.777965:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c6259450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:3295:x1869685684454656:12345-0@lo:103: Request processed in 548us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071297.777973:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783071297.778048:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.778056:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071297.778061:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec70b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071297.778135:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684454656:0@lo:103: 00000100:00100000:2.0:1783071297.783983:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:7476:x1869685684454400:12345-0@lo:253: Request processed in 40179us (41017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071297.783997:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783071297.784100:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:7476:1869685684454400:0@lo:253: 10000000:01000000:0.0:1783071297.784115:0:7476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783071297.784118:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071297.784132:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071297.784134:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071297.784135:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071297.784137:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071297.784138:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071297.784139:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071297.784141:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783071297.784142:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783071297.784144:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071297.784145:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783071297.784160:0:7476:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783071297.791492:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071297.792130:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071297.792376:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071297.793032:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071297.793249:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071297.793494:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783071297.795090:0:7476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783071297.972157:0:7476:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783071297.972164:0:7476:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783071297.972206:0:7476:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783071297.972289:0:7476:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783071297.972304:0:7476:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783071297.972328:0:7476:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783071298.720962:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071299.744872:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071300.770719:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071300.833012:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684454784:0@lo:13: 00000100:00100000:0.0:1783071300.833083:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071300.833218:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454784 00000100:00100000:1.0:1783071300.833227:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454784 00000100:00100000:1.0:1783071300.833301:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071300.833310:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684454784:12345-0@lo:13: 00002000:00000024:1.0:1783071300.833354:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071300.833396:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684454784:12345-0@lo:13: Request processed in 87us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071300.833404:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783071300.833527:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071300.833554:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824f480 x1869685684454784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071300.833572:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684454784:0@lo:13: 00010000:00010000:0.0:1783071301.793224:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071302.311352:0:7834:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783071302.819594:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071302.882434:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684454912:0@lo:400: 00000100:00100000:1.0:1783071302.882506:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071302.882554:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684455168:0@lo:400: 00000100:00100000:1.0:1783071302.882556:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684455424:0@lo:400: 00000100:00100000:1.0:1783071302.882581:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071302.882586:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684455040:0@lo:400: 00000100:00100000:3.0:1783071302.882607:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071302.882615:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684455296:0@lo:400: 00000100:00100000:3.0:1783071302.882630:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071302.882638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071302.882718:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455424 00000100:00100000:0.0:1783071302.882726:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455424 00000100:00100000:0.0:1783071302.882783:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455040 00000100:00100000:0.0:1783071302.882787:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455040 00000100:00100000:3.0:1783071302.882795:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455168 00000100:00100000:3.0:1783071302.882808:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455168 00000100:00100000:3.0:1783071302.882833:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071302.882841:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684455424:12345-0@lo:400: 00000100:00100000:0.0:1783071302.882979:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071302.882988:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684455168:12345-0@lo:400: 00000100:00100000:2.0:1783071302.883068:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455296 00000100:00100000:2.0:1783071302.883072:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455296 00000100:00100000:2.0:1783071302.883099:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071302.883106:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684455296:12345-0@lo:400: 00000100:00100000:1.0:1783071302.883194:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684454912 00000100:00100000:1.0:1783071302.883198:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684454912 00000100:00100000:1.0:1783071302.883222:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783071302.883228:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3292:x1869685684454912:12345-0@lo:400: 00000100:00100000:1.0:1783071302.883264:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3292:x1869685684454912:12345-0@lo:400: Request processed in 35us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071302.883271:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783071302.883327:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684454912:0@lo:400: 00000100:00100000:3.0:1783071302.888893:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684455424:12345-0@lo:400: Request processed in 6043us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071302.888919:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071302.888967:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783071302.888980:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684455040:12345-0@lo:400: 00000100:00100000:3.0:1783071302.889046:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684455040:12345-0@lo:400: Request processed in 71us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071302.889052:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783071302.889111:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824f480 x1869685684455424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071302.889125:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684455424:0@lo:400: 00010000:00080000:3.0:1783071302.889160:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824dc00 x1869685684455040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071302.889169:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684455040:0@lo:400: 00000100:00080000:0.0:1783071302.890012:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071302.890020:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071302.890058:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684455168:12345-0@lo:400: Request processed in 7070us (7424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071302.890067:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783071302.890118:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824e300 x1869685684455168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071302.890129:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684455168:0@lo:400: 00000100:00100000:3.0:1783071302.898833:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684455296:12345-0@lo:400: Request processed in 15717us (16183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071302.898848:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783071302.901059:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824c700 x1869685684455296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071302.901080:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684455296:0@lo:400: 00010000:00010000:3.0:1783071303.843404:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071304.864931:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071305.889221:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071305.952924:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684455552:0@lo:13: 00000100:00100000:0.0:1783071305.952995:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071305.953142:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455552 00000100:00100000:3.0:1783071305.953150:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455552 00000100:00100000:3.0:1783071305.953245:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071305.953256:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684455552:12345-0@lo:13: 00002000:00000024:3.0:1783071305.953302:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071305.953348:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684455552:12345-0@lo:13: Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071305.953356:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783071305.953393:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071305.953417:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c39880 x1869685684455552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071305.953430:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684455552:0@lo:13: 10000000:01000000:2.0:1783071306.465852:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783071306.465860:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782f9bac800 from 30 10000000:01000000:2.0:1783071306.465865:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071306.465916:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.465927:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.465937:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071306.465958:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455680:0@lo:101: 00000100:00100000:2.0:1783071306.466024:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.466065:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.466084:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455680 00000100:00100000:2.0:1783071306.466090:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455680 00000100:00100000:2.0:1783071306.466135:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783071306.466143:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684455680:12345-0@lo:101: 00010000:00010000:2.0:1783071306.466157:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071306.466169:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec70bb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.466193:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.466204:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.466213:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071306.466248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684455680:12345-0@lo:101: Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.466254:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783071306.466322:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455680:0@lo:101: 00010000:00010000:2.0:1783071306.466335:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.466343:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071306.466405:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455808:0@lo:501: 00000100:00100000:2.0:1783071306.466429:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.466443:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.466456:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455808 00000100:00100000:2.0:1783071306.466459:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455808 00000100:00100000:2.0:1783071306.466487:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071306.466494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684455808:12345-0@lo:501: 00000100:00100000:2.0:1783071306.466821:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684455808:12345-0@lo:501: Request processed in 326us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.466828:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071306.466958:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455808:0@lo:501: 00000100:00100000:2.0:1783071306.466986:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455936:0@lo:503: 00000100:00100000:2.0:1783071306.467020:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.467034:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.467045:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684455936 00000100:00100000:2.0:1783071306.467049:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684455936 00000100:00100000:2.0:1783071306.467071:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071306.467077:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684455936:12345-0@lo:503: 00000100:00100000:2.0:1783071306.467361:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684455936:12345-0@lo:503: Request processed in 283us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.467376:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071306.467413:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684455936:0@lo:503: 00000100:00100000:2.0:1783071306.467591:0:8040:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8040:1869685684456064:0@lo:502: 00000100:00100000:2.0:1783071306.467631:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.467651:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456064 00000100:00100000:2.0:1783071306.467655:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456064 00000100:00100000:2.0:1783071306.467696:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071306.467703:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8040:x1869685684456064:12345-0@lo:502: 00000100:00100000:2.0:1783071306.467908:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8040:x1869685684456064:12345-0@lo:502: Request processed in 205us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.467916:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071306.467946:0:8040:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.467958:0:8040:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8040:1869685684456064:0@lo:502: 00000100:00100000:2.0:1783071306.467997:0:8040:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8040:1869685684456192:0@lo:502: 00000100:00100000:2.0:1783071306.468029:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.468048:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456192 00000100:00100000:2.0:1783071306.468051:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456192 00000100:00100000:2.0:1783071306.468071:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071306.468077:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8040:x1869685684456192:12345-0@lo:502: 00000100:00100000:2.0:1783071306.468196:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8040:x1869685684456192:12345-0@lo:502: Request processed in 118us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.468203:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783071306.468230:0:8040:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.468242:0:8040:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8040:1869685684456192:0@lo:502: 00000040:00080000:2.0:1783071306.468268:0:8040:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783071306.468329:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783071306.468346:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071306.468355:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468365:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071306.468375:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783071306.468377:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783071306.468380:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071306.468402:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468410:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468419:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071306.468430:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456320:0@lo:101: 00000100:00100000:2.0:1783071306.468455:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.468468:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.468479:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456320 00000100:00100000:2.0:1783071306.468482:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456320 00000100:00100000:2.0:1783071306.468502:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783071306.468508:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684456320:12345-0@lo:101: 00010000:00010000:2.0:1783071306.468517:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071306.468534:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec70c9 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468555:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468566:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468574:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071306.468602:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456320:12345-0@lo:101: Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.468609:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783071306.468637:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456320:0@lo:101: 00010000:00010000:2.0:1783071306.468648:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071306.468657:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071306.468710:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456448:0@lo:501: 00000100:00100000:2.0:1783071306.468735:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.468748:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.468758:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456448 00000100:00100000:2.0:1783071306.468761:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456448 00000100:00100000:2.0:1783071306.468780:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783071306.468786:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456448:12345-0@lo:501: 00000100:00100000:2.0:1783071306.468964:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456448:12345-0@lo:501: Request processed in 177us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.468980:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783071306.469010:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456448:0@lo:501: 00000100:00100000:2.0:1783071306.469032:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456576:0@lo:503: 00000100:00100000:2.0:1783071306.469063:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.469075:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.469086:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456576 00000100:00100000:2.0:1783071306.469089:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456576 00000100:00100000:2.0:1783071306.469109:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783071306.469116:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456576:12345-0@lo:503: 00000100:00100000:2.0:1783071306.472566:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456576:12345-0@lo:503: Request processed in 3444us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.472579:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783071306.477520:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456576:0@lo:503: 00000100:00100000:0.0:1783071306.478146:0:8041:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8041:1869685684456704:0@lo:502: 00000100:00100000:0.0:1783071306.478218:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071306.478255:0:8041:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.478256:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456704 00000100:00100000:3.0:1783071306.478262:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456704 00000100:00100000:3.0:1783071306.478324:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783071306.478334:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8041:x1869685684456704:12345-0@lo:502: 00000100:00100000:3.0:1783071306.478711:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8041:x1869685684456704:12345-0@lo:502: Request processed in 377us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.478719:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783071306.479045:0:8041:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8041:1869685684456704:0@lo:502: 00000020:01000000:1.0:1783071306.479080:0:8041:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071306.479091:0:8041:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071306.479094:0:8041:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783071306.479100:0:8041:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071306.479102:0:8041:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783071306.479134:0:8041:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8041:1869685684456832:0@lo:502: 00000100:00100000:1.0:1783071306.479171:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071306.479233:0:8041:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.479339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456832 00000100:00100000:3.0:1783071306.479345:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456832 00000100:00100000:3.0:1783071306.479472:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783071306.479480:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8041:x1869685684456832:12345-0@lo:502: 00000100:00100000:3.0:1783071306.479625:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8041:x1869685684456832:12345-0@lo:502: Request processed in 146us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.479632:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783071306.479707:0:8041:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8041:1869685684456832:0@lo:502: 00000020:01000000:1.0:1783071306.479727:0:8041:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071306.479732:0:8041:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071306.479733:0:8041:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783071306.479737:0:8041:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1783071306.480094:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783071306.480116:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783071306.480198:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.480220:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071306.480230:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783071306.480233:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c8344000 from 30 10000000:01000000:3.0:1783071306.480236:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071306.480263:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.480283:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.480293:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.480308:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456960:0@lo:101: 00000100:00100000:3.0:1783071306.480340:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.480480:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071306.480518:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684456960 00000100:00100000:1.0:1783071306.480523:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684456960 00000100:00100000:1.0:1783071306.480591:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783071306.480598:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684456960:12345-0@lo:101: 00010000:00010000:1.0:1783071306.480609:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071306.480621:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec70d7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071306.480641:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071306.480651:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071306.480660:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7400, rc 0) 00000100:00100000:1.0:1783071306.480715:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684456960:12345-0@lo:101: Request processed in 117us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071306.480728:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783071306.480815:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684456960:0@lo:101: 00010000:00010000:1.0:1783071306.480827:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071306.480836:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071306.480996:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457088:0@lo:501: 00000100:00100000:1.0:1783071306.481237:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071306.481303:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e43cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.481339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457088 00000100:00100000:3.0:1783071306.481344:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457088 00000100:00100000:3.0:1783071306.481470:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783071306.481478:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684457088:12345-0@lo:501: 00000100:00100000:3.0:1783071306.481758:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684457088:12345-0@lo:501: Request processed in 279us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.481765:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783071306.481837:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457088:0@lo:501: 00000100:00100000:1.0:1783071306.482018:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457216:0@lo:503: 00000100:00100000:1.0:1783071306.482056:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071306.482075:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071306.482086:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457216 00000100:00100000:1.0:1783071306.482090:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457216 00000100:00100000:1.0:1783071306.482114:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071306.482192:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684457216:12345-0@lo:503: 00000100:00100000:1.0:1783071306.482342:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684457216:12345-0@lo:503: Request processed in 222us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071306.482348:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783071306.482482:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457216:0@lo:503: 00000100:00100000:1.0:1783071306.482998:0:8043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8043:1869685684457344:0@lo:502: 00000100:00100000:1.0:1783071306.483039:0:8043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071306.483575:0:8043:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e43cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.483590:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457344 00000100:00100000:2.0:1783071306.483596:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457344 00000100:00100000:2.0:1783071306.483632:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071306.483638:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8043:x1869685684457344:12345-0@lo:502: 00000100:00100000:2.0:1783071306.484163:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8043:x1869685684457344:12345-0@lo:502: Request processed in 522us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.484171:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783071306.484222:0:8043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8043:1869685684457344:0@lo:502: 00000100:00100000:2.0:1783071306.484286:0:8043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8043:1869685684457472:0@lo:502: 00000100:00100000:2.0:1783071306.484324:0:8043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.484354:0:8043:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.484388:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457472 00000100:00100000:3.0:1783071306.484392:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457472 00000100:00100000:3.0:1783071306.484422:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783071306.484434:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8043:x1869685684457472:12345-0@lo:502: 00000100:00100000:3.0:1783071306.484576:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8043:x1869685684457472:12345-0@lo:502: Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.484582:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783071306.484613:0:8043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8043:1869685684457472:0@lo:502: 00000040:00080000:3.0:1783071306.484631:0:8043:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1783071306.484703:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1783071306.484719:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071306.484729:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484740:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071306.484749:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783071306.484751:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9782c8344000 from 5 10000000:01000000:3.0:1783071306.484754:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783071306.484779:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484787:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484795:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.484807:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457600:0@lo:101: 00000100:00100000:3.0:1783071306.484835:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.484863:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.484880:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457600 00000100:00100000:3.0:1783071306.484884:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457600 00000100:00100000:3.0:1783071306.484904:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783071306.484911:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684457600:12345-0@lo:101: 00010000:00010000:3.0:1783071306.484919:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071306.484931:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cf600/0xd360fc6ce6ec70ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec70e5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484951:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cf600/0xd360fc6ce6ec70ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70e5 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484960:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cf600/0xd360fc6ce6ec70ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70e5 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.484968:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cf600, rc 0) 00000100:00100000:3.0:1783071306.484995:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684457600:12345-0@lo:101: Request processed in 85us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.485001:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783071306.485033:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457600:0@lo:101: 00010000:00010000:3.0:1783071306.485044:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485052:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.485091:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457728:0@lo:256: 00000100:00100000:3.0:1783071306.485133:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.485147:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.485158:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457728 00000100:00100000:3.0:1783071306.485166:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457728 00000100:00100000:2.0:1783071306.485186:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783071306.485199:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684457728:12345-0@lo:256: 20000000:01000000:2.0:1783071306.485220:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071306.485234:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071306.485237:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783071306.485319:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684457728:12345-0@lo:256: Request processed in 125us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.485729:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457728:0@lo:256: 10000000:01000000:3.0:1783071306.485767:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071306.485774:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485781:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071306.485787:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783071306.485789:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783071306.485791:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783071306.485807:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485813:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485820:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.485832:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457856:0@lo:101: 00000100:00100000:3.0:1783071306.485868:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.485889:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.485899:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457856 00000100:00100000:3.0:1783071306.485902:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457856 00000100:00100000:3.0:1783071306.485923:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783071306.485929:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684457856:12345-0@lo:101: 00010000:00010000:3.0:1783071306.485937:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071306.485951:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec70f3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485966:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485974:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.485982:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cf400, rc 0) 00000100:00100000:3.0:1783071306.486007:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684457856:12345-0@lo:101: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.486013:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783071306.486041:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457856:0@lo:101: 00010000:00010000:3.0:1783071306.486051:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.486058:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.486095:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457984:0@lo:501: 00000100:00100000:3.0:1783071306.486135:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.486147:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.486157:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684457984 00000100:00100000:3.0:1783071306.486160:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684457984 00000100:00100000:3.0:1783071306.486179:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783071306.486185:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684457984:12345-0@lo:501: 00000100:00100000:3.0:1783071306.486645:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684457984:12345-0@lo:501: Request processed in 459us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.486660:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783071306.486710:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684457984:0@lo:501: 00000100:00100000:3.0:1783071306.486740:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684458112:0@lo:503: 00000100:00100000:3.0:1783071306.486776:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.486789:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.486802:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458112 00000100:00100000:3.0:1783071306.486805:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458112 00000100:00100000:3.0:1783071306.486825:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783071306.486830:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684458112:12345-0@lo:503: 00000100:00100000:3.0:1783071306.487107:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684458112:12345-0@lo:503: Request processed in 275us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.487114:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783071306.487150:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684458112:0@lo:503: 00000100:00100000:3.0:1783071306.488555:0:8044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8044:1869685684458240:0@lo:502: 00000100:00100000:3.0:1783071306.488615:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.488652:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458240 00000100:00100000:3.0:1783071306.488658:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458240 00000100:00100000:3.0:1783071306.488705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071306.488712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:8044:x1869685684458240:12345-0@lo:502: 00000100:00100000:2.0:1783071306.488924:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783071306.488978:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8044:x1869685684458240:12345-0@lo:502: Request processed in 266us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.488985:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071306.489017:0:8044:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.489035:0:8044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8044:1869685684458240:0@lo:502: 00000020:01000000:3.0:1783071306.489066:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783071306.489074:0:8044:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783071306.489080:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071306.489082:0:8044:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783071306.489087:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783071306.489091:0:8044:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:3.0:1783071306.489112:0:8044:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783071306.489115:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783071306.489794:0:8044:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9782f9ec4d40) 00000020:00000080:3.0:1783071306.489819:0:8044:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783071306.489828:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783071306.490062:0:8044:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783071306.490068:0:8044:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783071306.490085:0:8044:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec7108 00010000:00080000:3.0:1783071306.490116:0:8044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9782c6339000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1783071306.490798:0:8044:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1783071306.491571:0:8044:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783071306.491588:0:8044:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783071306.492497:0:8044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071306.493445:0:8044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071306.493563:0:8044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783071306.493624:0:8044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783071306.494042:0:8046:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071306.494046:0:8046:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783071306.494993:0:8044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783071306.495005:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783071306.495037:0:8044:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783071306.495058:0:8044:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec710f 00000100:00080000:3.0:1783071306.495069:0:8044:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071306.495076:0:8044:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9782c6339000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1783071306.495115:0:8044:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782c5c3b480 x1869685684458368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071306.495288:0:8044:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783071306.495335:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071306.495340:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071306.495342:0:8044:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783071306.495345:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071306.495349:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071306.495351:0:8044:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783071306.495354:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783071306.495356:0:8044:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783071306.495451:0:8044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8044:1869685684458496:0@lo:502: 00000100:00100000:3.0:1783071306.495584:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.495628:0:8044:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94300 going to sleep for 11 seconds 00000100:00100000:3.0:1783071306.495648:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684458368:0@lo:8: 00000100:00100000:3.0:1783071306.495698:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.495778:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458368 00000100:00100000:3.0:1783071306.495784:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458368 00000100:00100000:3.0:1783071306.495811:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071306.495818:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3291:x1869685684458368:12345-0@lo:8: 00010000:00080000:3.0:1783071306.495838:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1783071306.495913:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec7116 00002000:00100000:3.0:1783071306.495926:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9781c65c3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783071306.495930:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1783071306.495934:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783071306.496036:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783071306.496254:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783071306.496289:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9781c65c7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071306.496346:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1869685684458368:12345-0@lo:8: Request processed in 527us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.496354:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071306.496390:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684458624:0@lo:400: 00000100:00100000:3.0:1783071306.496419:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.496440:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071306.496446:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684458752:0@lo:400: 00000100:00100000:3.0:1783071306.496488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.496521:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684458880:0@lo:400: 00000100:00100000:3.0:1783071306.496545:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.496579:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458624 00000100:00100000:3.0:1783071306.496583:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458624 00000100:00100000:3.0:1783071306.496616:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458752 00000100:00100000:3.0:1783071306.496619:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458752 00000100:00100000:3.0:1783071306.496639:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458880 00000100:00100000:3.0:1783071306.496641:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458880 00000100:00100000:3.0:1783071306.496654:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783071306.496659:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684458624:12345-0@lo:400: 00000100:00100000:3.0:1783071306.496738:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684458624:12345-0@lo:400: Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071306.496738:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071306.496745:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071306.496747:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684458752:12345-0@lo:400: 00000100:00100000:3.0:1783071306.496756:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071306.496761:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684458880:12345-0@lo:400: 00000100:00100000:0.0:1783071306.496780:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684458752:12345-0@lo:400: Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.496787:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684458880:12345-0@lo:400: Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071306.496792:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071306.496872:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783071306.496894:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783071306.496916:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c3a680 x1869685684458880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.496936:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684458880:0@lo:400: 00010000:00080000:3.0:1783071306.496966:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c3b480 x1869685684458368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.496973:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1783071306.496975:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684458496 00000100:00100000:2.0:1783071306.496979:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684458496 00000100:00080000:3.0:1783071306.496980:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783071306.496987:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783071306.496991:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783071306.496994:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782c6339000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783071306.497003:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783071306.497008:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684458368:0@lo:8: 00010000:00080000:3.0:1783071306.497031:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c39f80 x1869685684458752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.497039:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684458752:0@lo:400: 00000100:00100000:2.0:1783071306.497042:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1783071306.497048:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c39c00 x1869685684458624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071306.497050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8044:x1869685684458496:12345-0@lo:502: 00000100:00100000:3.0:1783071306.497057:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684458624:0@lo:400: 00000004:00080000:3.0:1783071306.497075:0:8046:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1783071306.497282:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8044:x1869685684458496:12345-0@lo:502: Request processed in 222us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.497286:0:8044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8044:1869685684458496:0@lo:502: 00000100:00100000:2.0:1783071306.497289:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:01000000:3.0:1783071306.497309:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071306.497314:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071306.497316:0:8044:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783071306.497320:0:8044:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1783071306.497437:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783071306.497453:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783071306.497755:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.497766:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071306.497775:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783071306.497778:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9782c5bbb380 from 1 10000000:01000000:3.0:1783071306.497781:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783071306.497810:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.497818:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.497827:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.497842:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684459008:0@lo:101: 00000100:00100000:3.0:1783071306.498041:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.498067:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071306.498081:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459008 00000100:00100000:0.0:1783071306.498086:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459008 00000100:00100000:0.0:1783071306.498125:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071306.498132:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684459008:12345-0@lo:101: 00010000:00010000:0.0:1783071306.498143:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071306.498155:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec711d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071306.498177:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071306.498187:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071306.498195:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030c00, rc 0) 00000100:00100000:0.0:1783071306.498232:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684459008:12345-0@lo:101: Request processed in 101us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071306.498238:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071306.498262:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684459008:0@lo:101: 00010000:00010000:3.0:1783071306.498284:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.498293:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071306.498335:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684459136:0@lo:501: 00000100:00100000:3.0:1783071306.498369:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.498450:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071306.498521:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459136 00000100:00100000:0.0:1783071306.498526:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459136 00000100:00100000:0.0:1783071306.498545:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783071306.498550:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684459136:12345-0@lo:501: 00000004:00080000:3.0:1783071306.498551:0:8046:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207872876288ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783071306.498760:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684459136:12345-0@lo:501: Request processed in 207us (388us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071306.498766:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071306.498920:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684459136:0@lo:501: 10000000:01000000:3.0:1783071306.498940:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783071306.498946:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071306.498953:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071306.539952:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:2.0:1783071306.542090:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1783071306.572655:0:8047:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783071306.572700:0:8047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459392:0@lo:7: 00000100:00100000:2.0:1783071306.572766:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.572813:0:8047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31f9840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.572842:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684459264:0@lo:13: 00000100:00100000:2.0:1783071306.573158:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.573298:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459392 00000100:00100000:2.0:1783071306.573305:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459392 00000100:00100000:2.0:1783071306.573363:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071306.573373:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8047:x1869685684459392:12345-0@lo:7: 00000100:00100000:0.0:1783071306.575327:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459264 00000100:00100000:0.0:1783071306.575341:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459264 00000100:00100000:0.0:1783071306.575424:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071306.575434:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1869685684459264:12345-0@lo:13: 00002000:00000024:0.0:1783071306.575465:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783071306.575548:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1869685684459264:12345-0@lo:13: Request processed in 116us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071306.575556:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783071306.578735:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783071306.579779:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e27800 x1869685684459264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.579805:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684459264:0@lo:13: 00002000:00080000:3.0:1783071306.590065:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783071306.590073:0:6587:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783071306.591227:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8047:x1869685684459392:12345-0@lo:7: Request processed in 17848us (18453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071306.591241:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783071306.592291:0:8047:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e26300 x1869685684459392/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783071322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.592307:0:8047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459392:0@lo:7: 00000004:00080000:3.0:1783071306.592320:0:8047:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783071306.592358:0:8047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459520:0@lo:5: 00000100:00100000:3.0:1783071306.592407:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071306.592473:0:8047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.592808:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459520 00000100:00100000:2.0:1783071306.592817:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459520 00000100:00100000:2.0:1783071306.592870:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071306.592878:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8047:x1869685684459520:12345-0@lo:5: 00002000:00080000:2.0:1783071306.592907:0:6585:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783071306.592910:0:6585:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783071306.594877:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8047:x1869685684459520:12345-0@lo:5: Request processed in 1989us (2459us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783071306.594893:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783071306.594947:0:8047:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcdf80 x1869685684459520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071306.594968:0:8047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459520:0@lo:5: 00000004:00080000:2.0:1783071306.594984:0:8047:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783071306.595024:0:8047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459648:0@lo:700: 00000100:00100000:2.0:1783071306.595063:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.595099:0:8047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.595121:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459648 00000100:00100000:2.0:1783071306.595128:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459648 00000100:00100000:2.0:1783071306.595168:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071306.595176:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8047:x1869685684459648:12345-0@lo:700: 00000100:00100000:2.0:1783071306.595214:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6594:1869685684459776:0@lo:700: 00000100:00100000:2.0:1783071306.595311:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071306.595365:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071306.595459:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459776 00000100:00100000:2.0:1783071306.595463:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459776 00000100:00100000:2.0:1783071306.595496:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071306.595502:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6594:x1869685684459776:12345-0@lo:700: 40000000:02000000:2.0:1783071306.626868:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783071306.632317:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6594:x1869685684459776:12345-0@lo:700: Request processed in 36806us (37058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.632333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783071306.632407:0:6594:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e26300 x1869685684459776/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783071322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071306.632423:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6594:1869685684459776:0@lo:700: 40000000:02000000:0.0:1783071306.632436:0:6594:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1783071306.698755:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1783071306.699225:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8047:x1869685684459648:12345-0@lo:700: Request processed in 104045us (104156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071306.699238:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783071306.699339:0:8047:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e26680 x1869685684459648/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783071322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071306.699352:0:8047:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783071306.699366:0:8047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459648:0@lo:700: 00000004:02000040:2.0:1783071306.738222:0:8047:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1783071306.746485:0:8047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459904:0@lo:5: 00000100:00100000:1.0:1783071306.746560:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071306.746611:0:8047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071306.746633:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684459904 00000100:00100000:1.0:1783071306.746639:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684459904 00000100:00100000:2.0:1783071306.746791:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071306.746803:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8047:x1869685684459904:12345-0@lo:5: 00002000:00080000:2.0:1783071306.756051:0:6588:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783071306.756066:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783071306.766655:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8047:x1869685684459904:12345-0@lo:5: Request processed in 19848us (20088us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783071306.766668:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783071306.766778:0:8047:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824c380 x1869685684459904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783071322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071306.766799:0:8047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8047:1869685684459904:0@lo:5: 00000004:00080000:3.0:1783071306.766815:0:8047:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1783071306.857021:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783071306.916445:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071307.839963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.843412:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563008 00000100:00100000:0.0:1783071307.843427:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563008 00000100:00100000:0.0:1783071307.843498:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:0.0:1783071307.843508:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2354:x1869685665563008:12345-192.168.202.16@tcp:250: 00010000:00080000:0.0:1783071307.843538:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5670ebf1-2342-40c4-8ac4-3a3856f168dd@192.168.202.16@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1783071307.843571:0:5783:0:(genops.c:1406:class_connect()) connect: client 5670ebf1-2342-40c4-8ac4-3a3856f168dd, cookie 0xd360fc6ce6ec712b 00000100:00080000:0.0:1783071307.843888:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071307.844009:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+5:2354:x1869685665563008:12345-192.168.202.16@tcp:250: Request processed in 500us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.844017:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:2.0:1783071307.850561:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.850632:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665562880 00000100:00100000:0.0:1783071307.850639:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665562880 00000100:00100000:0.0:1783071307.850700:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:0.0:1783071307.850707:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+5:5555:x1869685665562880:12345-192.168.202.16@tcp:101: 00010000:00010000:0.0:1783071307.850720:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071307.850753:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca7c6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.850783:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.850792:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.850799:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031000, rc 0) 00000100:00100000:0.0:1783071307.850848:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+6:5555:x1869685665562880:12345-192.168.202.16@tcp:101: Request processed in 141us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.850853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:3.0:1783071307.855814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.855908:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563136 00000100:00100000:0.0:1783071307.855917:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563136 00000100:00100000:0.0:1783071307.855984:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:0.0:1783071307.855994:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+6:5555:x1869685665563136:12345-192.168.202.16@tcp:501: 00000100:00100000:0.0:1783071307.856821:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+6:5555:x1869685665563136:12345-192.168.202.16@tcp:501: Request processed in 825us (1012us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071307.856831:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:3.0:1783071307.862384:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.863744:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563264 00000100:00100000:0.0:1783071307.863759:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563264 00000100:00100000:0.0:1783071307.863877:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:0.0:1783071307.863889:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+6:5555:x1869685665563264:12345-192.168.202.16@tcp:101: 00010000:00010000:0.0:1783071307.863905:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071307.863921:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca7cd expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.863965:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.863986:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071307.863996:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031400, rc 0) 00000100:00100000:0.0:1783071307.864057:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+7:5555:x1869685665563264:12345-192.168.202.16@tcp:101: Request processed in 171us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.864069:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:3.0:1783071307.867157:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.867238:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563392 00000100:00100000:0.0:1783071307.867247:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563392 00000100:00100000:0.0:1783071307.867314:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:0.0:1783071307.867323:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+7:5555:x1869685665563392:12345-192.168.202.16@tcp:501: 00000100:00100000:0.0:1783071307.867606:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5555:x1869685665563392:12345-192.168.202.16@tcp:501: Request processed in 283us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.867614:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:3.0:1783071307.871333:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.871397:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563520 00000100:00100000:0.0:1783071307.871407:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563520 00000100:00100000:0.0:1783071307.871520:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:0.0:1783071307.871531:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5555:x1869685665563520:12345-192.168.202.16@tcp:503: 00000100:00100000:0.0:1783071307.871888:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5555:x1869685665563520:12345-192.168.202.16@tcp:503: Request processed in 357us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.871896:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1783071307.878284:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071307.878859:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563648 00000100:00100000:2.0:1783071307.878869:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563648 00000100:00100000:2.0:1783071307.878928:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:2.0:1783071307.878939:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5574:x1869685665563648:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1783071307.879312:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5574:x1869685665563648:12345-192.168.202.16@tcp:502: Request processed in 374us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071307.879330:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:3.0:1783071307.900033:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.900815:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563776 00000100:00100000:0.0:1783071307.900839:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563776 00000100:00100000:0.0:1783071307.900899:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:0.0:1783071307.900910:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5574:x1869685665563776:12345-192.168.202.16@tcp:502: 00000100:00100000:0.0:1783071307.901224:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5574:x1869685665563776:12345-192.168.202.16@tcp:502: Request processed in 316us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.901230:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:3.0:1783071307.910940:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071307.912848:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665563904 00000100:00100000:2.0:1783071307.912861:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665563904 00000100:00100000:2.0:1783071307.912918:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1783071307.912929:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5555:x1869685665563904:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1783071307.913229:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071307.913249:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec7140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca7f7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.913288:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec7140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7f7 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.913300:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec7140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7f7 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.913309:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938200, rc 0) 00000100:00100000:2.0:1783071307.913374:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5555:x1869685665563904:12345-192.168.202.16@tcp:101: Request processed in 446us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071307.913382:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1783071307.919352:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071307.919448:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564032 00000100:00100000:1.0:1783071307.919458:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564032 00000100:00100000:1.0:1783071307.919510:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1783071307.919520:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5555:x1869685665564032:12345-192.168.202.16@tcp:256: 20000000:01000000:1.0:1783071307.919545:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783071307.919570:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783071307.919575:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783071307.919578:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783071307.919581:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783071307.922989:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5555:x1869685665564032:12345-192.168.202.16@tcp:256: Request processed in 3461us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071307.923001:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:3.0:1783071307.932309:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071307.932461:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564160 00000100:00100000:2.0:1783071307.932469:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564160 00000100:00100000:2.0:1783071307.932510:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1783071307.932517:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5555:x1869685665564160:12345-192.168.202.16@tcp:101: 00010000:00010000:2.0:1783071307.932530:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071307.932542:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca7fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.932580:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.932587:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071307.932594:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939400, rc 0) 00000100:00100000:2.0:1783071307.932649:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5555:x1869685665564160:12345-192.168.202.16@tcp:101: Request processed in 132us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071307.932653:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1783071307.934398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071307.934487:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564288 00000100:00100000:1.0:1783071307.934494:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564288 00000100:00100000:1.0:1783071307.934542:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1783071307.934550:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5555:x1869685665564288:12345-192.168.202.16@tcp:501: 00000100:00100000:1.0:1783071307.934900:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5555:x1869685665564288:12345-192.168.202.16@tcp:501: Request processed in 348us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071307.934908:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:3.0:1783071307.936996:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071307.937348:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564416 00000100:00100000:1.0:1783071307.937357:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564416 00000100:00100000:1.0:1783071307.937411:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1783071307.937434:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5555:x1869685665564416:12345-192.168.202.16@tcp:503: 00000100:00100000:1.0:1783071307.937849:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5555:x1869685665564416:12345-192.168.202.16@tcp:503: Request processed in 415us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071307.937857:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00010000:00010000:0.0:1783071307.940928:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071307.941471:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071307.941561:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564544 00000100:00100000:2.0:1783071307.941572:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564544 00000100:00100000:2.0:1783071307.941628:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1783071307.941638:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5579:x1869685665564544:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1783071307.941936:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5579:x1869685665564544:12345-192.168.202.16@tcp:502: Request processed in 298us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071307.941944:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:3.0:1783071307.945428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071307.945671:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564672 00000100:00100000:2.0:1783071307.945699:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564672 00000100:00100000:2.0:1783071307.945835:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:2.0:1783071307.945845:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5579:x1869685665564672:12345-192.168.202.16@tcp:502: 00000100:00100000:2.0:1783071307.946073:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5579:x1869685665564672:12345-192.168.202.16@tcp:502: Request processed in 229us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071307.946081:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:3.0:1783071307.950329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071307.950424:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564800 00000100:00100000:0.0:1783071307.950434:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564800 00000100:00100000:0.0:1783071307.950482:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1783071307.950489:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1869685665564800:12345-192.168.202.16@tcp:38: 00010000:00080000:0.0:1783071307.950517:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1783071307.950564:0:5793:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec714e 00000004:00100000:0.0:1783071307.950593:0:5793:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1783071307.950598:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1783071307.987276:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071307.987365:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665564800:12345-192.168.202.16@tcp:38: Request processed in 36874us (37045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071307.987377:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00010000:00010000:2.0:1783071308.961628:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071308.993783:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071308.993827:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071308.993918:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565056 00000100:00100000:1.0:1783071308.993928:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565056 00000100:00100000:1.0:1783071308.993993:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665564928 00000100:00100000:1.0:1783071308.993996:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665564928 00000100:00100000:1.0:1783071308.994017:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071308.994026:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:5555:x1869685665565056:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1783071308.994070:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783071308.994132:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:5555:x1869685665565056:12345-192.168.202.16@tcp:41: Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071308.994140:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071308.994160:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1783071308.994166:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:0:x1869685665564928:12345-192.168.202.16@tcp:41: 00000004:00000024:1.0:1783071308.994178:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783071308.994197:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:0:x1869685665564928:12345-192.168.202.16@tcp:41: Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071308.994203:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:0.0:1783071308.994559:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071308.996781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071308.996910:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565184 00000100:00100000:3.0:1783071308.996921:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565184 00000100:00100000:3.0:1783071308.996981:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071308.996991:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5555:x1869685665565184:12345-192.168.202.16@tcp:40: 00000100:00100000:3.0:1783071308.997074:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5555:x1869685665565184:12345-192.168.202.16@tcp:40: Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071308.997081:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071309.000091:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071309.000144:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071309.000172:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071309.000218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071309.000232:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565568 00000100:00100000:1.0:1783071309.000242:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565568 00000100:00100000:3.0:1783071309.000275:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565696 00000100:00100000:3.0:1783071309.000280:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565696 00000100:00100000:1.0:1783071309.000301:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1783071309.000313:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1783071309.000321:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665565696:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1783071309.000377:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5555:x1869685665565568:12345-192.168.202.16@tcp:33: 00000100:00100000:3.0:1783071309.000387:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665565696:12345-192.168.202.16@tcp:400: Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071309.000395:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:0.0:1783071309.001913:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565312 00000100:00100000:0.0:1783071309.001922:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565312 00000100:00100000:0.0:1783071309.001952:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565440 00000100:00100000:0.0:1783071309.001955:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565440 00000100:00100000:0.0:1783071309.001969:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071309.001976:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869685665565312:12345-192.168.202.16@tcp:8: 00010000:00080000:0.0:1783071309.002008:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1783071309.002033:0:6587:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec7155 00002000:00100000:0.0:1783071309.002043:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a/ffff9782c2ece000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071309.002065:0:6587:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071309.002379:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783071309.002409:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071309.002472:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665565312:12345-192.168.202.16@tcp:8: Request processed in 495us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071309.002479:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071309.002497:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1783071309.002501:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869685665565440:12345-192.168.202.16@tcp:8: 00010000:00080000:0.0:1783071309.002534:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1783071309.002554:0:6587:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec715c 00002000:00100000:0.0:1783071309.002560:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a/ffff9782c2ecc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071309.002574:0:6587:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071309.003293:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783071309.003312:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782c2eca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071309.003361:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665565440:12345-192.168.202.16@tcp:8: Request processed in 857us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071309.003369:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000004:00080000:3.0:1783071309.028519:0:5794:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28057us 00000004:00200000:3.0:1783071309.052870:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783071309.053222:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5555:x1869685665565568:12345-192.168.202.16@tcp:33: Request processed in 52906us (53135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071309.053237:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1783071309.209561:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071309.210997:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565824 00000100:00100000:0.0:1783071309.211008:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565824 00000100:00100000:0.0:1783071309.211120:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071309.211131:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5596:x1869685665565824:12345-192.168.202.16@tcp:101: 00010000:00010000:0.0:1783071309.211163:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071309.211222:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec7163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca828 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211308:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211321:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211333:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071309.211516:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783071309.211520:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071309.211595:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211621:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec7163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca828 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211637:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca828 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071309.211645:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071309.211647:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071309.211650:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030200, rc 0) 00000100:00100000:0.0:1783071309.211752:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:5596:x1869685665565824:12345-192.168.202.16@tcp:101: Request processed in 622us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071309.211760:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:0.0:1783071309.984885:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783071310.073796:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00010000:00010000:2.0:1783071311.016347:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071311.066380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071311.067130:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665565952 00000100:00100000:3.0:1783071311.067141:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665565952 00000100:00100000:3.0:1783071311.067228:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071311.067251:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:5649:x1869685665565952:12345-192.168.202.16@tcp:41: 00000004:00000024:3.0:1783071311.067296:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783071311.067368:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:5649:x1869685665565952:12345-192.168.202.16@tcp:41: Request processed in 131us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071311.067377:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00080000:1.0:1783071311.067783:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071311.071580:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071311.075432:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566080 00000100:00100000:0.0:1783071311.075448:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566080 00000100:00100000:0.0:1783071311.075536:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1783071311.075546:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:5649:x1869685665566080:12345-192.168.202.16@tcp:13: 00002000:00000024:0.0:1783071311.075594:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071311.075669:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:5649:x1869685665566080:12345-192.168.202.16@tcp:13: Request processed in 124us (4099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071311.075693:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:1.0:1783071311.076492:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071311.080537:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071311.080565:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684460032:0@lo:13: 00000100:00100000:1.0:1783071311.080635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071311.080951:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460032 00000100:00100000:3.0:1783071311.080958:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460032 00000100:00100000:3.0:1783071311.081028:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071311.081036:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684460032:12345-0@lo:13: 00002000:00000024:3.0:1783071311.081067:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783071311.081167:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071311.082244:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684460032:12345-0@lo:13: Request processed in 1196us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071311.082254:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783071311.082415:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcfb80 x1869685684460032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071311.082435:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684460032:0@lo:13: 00000100:00100000:2.0:1783071311.082692:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071311.085515:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566208 00000100:00100000:0.0:1783071311.085527:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566208 00000100:00100000:0.0:1783071311.085662:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071311.085684:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5649:x1869685665566208:12345-192.168.202.16@tcp:13: 00002000:00000024:0.0:1783071311.085718:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071311.085785:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:5649:x1869685665566208:12345-192.168.202.16@tcp:13: Request processed in 114us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071311.085792:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00080000:1.0:1783071311.089493:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071311.585441:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684460160:0@lo:13: 00000100:00100000:1.0:1783071311.585509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071311.585584:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460160 00000100:00100000:1.0:1783071311.585591:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460160 00000100:00100000:1.0:1783071311.585642:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071311.585651:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684460160:12345-0@lo:13: 00002000:00000024:1.0:1783071311.585690:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071311.585735:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684460160:12345-0@lo:13: Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071311.585743:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783071311.585764:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783071311.585797:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c824c700 x1869685684460160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071311.585808:0:3295:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783071311.585826:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684460160:0@lo:13: 00000100:00100000:2.0:1783071311.586101:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684460416:0@lo:400: 00000100:00100000:2.0:1783071311.586134:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071311.586169:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071311.586175:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684460288:0@lo:400: 00000100:00100000:2.0:1783071311.586202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071311.586242:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460288 00000100:00100000:2.0:1783071311.586246:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460288 00000100:00100000:2.0:1783071311.586274:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783071311.586281:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684460288:12345-0@lo:400: 00000100:00100000:2.0:1783071311.586317:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684460288:12345-0@lo:400: Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071311.586323:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783071311.586354:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684460288:0@lo:400: 00000100:00100000:2.0:1783071311.586380:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460416 00000100:00100000:2.0:1783071311.586495:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460416 00000100:00100000:2.0:1783071311.586531:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071311.586539:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684460416:12345-0@lo:400: 00000100:00100000:2.0:1783071311.586577:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684460416:12345-0@lo:400: Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071311.586582:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071311.586606:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684460416:0@lo:400: 00000100:00100000:1.0:1783071311.586706:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684460544:0@lo:400: 00000100:00100000:1.0:1783071311.586744:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071311.586759:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071311.586764:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684460672:0@lo:400: 00000100:00100000:1.0:1783071311.586788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071311.586813:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460544 00000100:00100000:1.0:1783071311.586817:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460544 00000100:00100000:1.0:1783071311.586843:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460672 00000100:00100000:1.0:1783071311.586845:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460672 00000100:00100000:1.0:1783071311.586860:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071311.586866:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684460544:12345-0@lo:400: 00000100:00100000:1.0:1783071311.586912:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684460544:12345-0@lo:400: Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071311.586917:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783071311.586929:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071311.586934:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684460672:12345-0@lo:400: 00000100:00100000:1.0:1783071311.586959:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684460672:12345-0@lo:400: Request processed in 25us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071311.586964:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1783071311.586978:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071311.586994:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684460672:0@lo:400: 00000100:00100000:1.0:1783071311.587003:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684460544:0@lo:400: 00010000:00010000:3.0:1783071312.036130:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071312.638628:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000001:02000400:3.0:1783071313.011184:0:8150:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783071313.060051:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783071313.153583:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00010000:00010000:3.0:1783071314.080810:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071314.369846:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071314.369899:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071314.369930:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071314.369977:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071314.370008:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566464 00000100:00100000:1.0:1783071314.370023:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566464 00000100:00100000:1.0:1783071314.370080:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071314.370091:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665566464:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1783071314.370167:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665566464:12345-192.168.202.16@tcp:400: Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071314.370175:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071314.370216:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566592 00000100:00100000:1.0:1783071314.370220:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566592 00000100:00100000:1.0:1783071314.370243:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566720 00000100:00100000:1.0:1783071314.370245:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566720 00000100:00100000:1.0:1783071314.370258:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1783071314.370265:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665566592:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1783071314.370293:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665566592:12345-192.168.202.16@tcp:400: Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071314.370300:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1783071314.370312:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071314.370318:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665566720:12345-192.168.202.16@tcp:400: 00000100:00100000:1.0:1783071314.370341:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665566720:12345-192.168.202.16@tcp:400: Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071314.370346:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00080000:1.0:1783071314.370360:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071314.370377:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071314.370380:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071314.370595:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566336 00000100:00100000:3.0:1783071314.370601:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566336 00000100:00100000:3.0:1783071314.370638:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:3.0:1783071314.370646:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665566336:12345-192.168.202.16@tcp:400: 00000100:00100000:3.0:1783071314.370710:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665566336:12345-192.168.202.16@tcp:400: Request processed in 65us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071314.370717:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00010000:00010000:0.0:1783071315.108046:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071316.128787:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783071316.188574:0:8298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee092fbb0 20000000:00000080:3.0:1783071316.188592:0:8298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9781c6051c00 uarg=0000000000000000 20000000:01000000:3.0:1783071316.188629:0:8298:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1783071316.188632:0:8298:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1783071316.188635:0:8298:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783071316.188639:0:8298:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783071316.188644:0:8298:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1783071316.188658:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783071316.188660:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783071316.190435:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783071316.190443:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783071316.192554:0:8299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1783071316.193162:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1783071316.193238:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1783071316.193294:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1783071316.193309:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783071316.193313:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783071316.194267:0:8300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1783071316.194655:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1783071316.194754:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1783071316.194791:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1783071316.194805:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783071316.194808:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000100:00100000:1.0:1783071316.195200:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684460800:0@lo:13: 00000100:00100000:1.0:1783071316.195279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.195946:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684460800 00000100:00100000:2.0:1783071316.195955:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684460800 00000100:00100000:2.0:1783071316.196042:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071316.196053:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684460800:12345-0@lo:13: 00002000:00000024:2.0:1783071316.196088:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783071316.196487:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783071316.198431:0:8301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1783071316.199051:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1783071316.199122:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1783071316.199173:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1783071316.199186:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783071316.199189:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000100:00100000:2.0:1783071316.201246:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684460800:12345-0@lo:13: Request processed in 5185us (5957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.201263:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1783071316.203173:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bce680 x1869685684460800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071316.203211:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684460800:0@lo:13: 00000040:00080000:0.0:1783071316.203537:0:8302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783071316.204596:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783071316.204648:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783071316.204721:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1783071316.204740:0:8298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783071316.204760:0:8298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204778:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204787:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204793:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204799:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204806:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204826:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204833:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204843:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204850:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204859:0:8298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204896:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.204911:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 9 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.204926:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684460928:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071316.205211:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.205220:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.205229:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461056:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071316.205272:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.205280:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 18 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.205289:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461184:0@lo:104: 00000100:00100000:2.0:1783071316.205333:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071316.205371:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.205379:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 18 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.205386:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461312:0@lo:104: 00000100:00100000:2.0:1783071316.205409:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.205450:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783071316.205461:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461184 00000100:00100000:2.0:1783071316.205468:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461184 00000100:00100000:2.0:1783071316.205509:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461312 00000100:00100000:2.0:1783071316.205513:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461312 00000100:00100000:2.0:1783071316.205527:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071316.205535:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8298:x1869685684461184:12345-0@lo:104: 00010000:00010000:2.0:1783071316.205548:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.205591:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071316.205596:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8298:x1869685684461184:12345-0@lo:104: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.205610:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071316.205627:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783071316.205633:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c6ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:8298:x1869685684461312:12345-0@lo:104: 00010000:00010000:2.0:1783071316.205640:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.205669:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1783071316.206795:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071316.206805:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206814:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020ce200 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.206818:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206827:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.206834:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.206840:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.206890:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206897:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.206920:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206927:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020ce200/0xd360fc6ce6ec711d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7124 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206944:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071316.206947:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206963:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cfc00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.206966:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.206972:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.206977:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.206981:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.207020:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207027:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.207042:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207048:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cfc00/0xd360fc6ce6ec70f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207056:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071316.207058:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071316.207060:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071316.207075:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684461440:0@lo:103: 00000100:00100000:0.0:1783071316.207119:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.207161:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684461568:0@lo:103: 00000100:00100000:0.0:1783071316.207184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.207241:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461440 00000100:00100000:0.0:1783071316.207247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461440 00010000:00010000:0.0:1783071316.207273:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 19 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.207295:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461568 00000100:00100000:0.0:1783071316.207298:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461568 00010000:00010000:0.0:1783071316.207310:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.207323:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071316.207330:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3293:x1869685684461440:12345-0@lo:103: 00010000:00010000:0.0:1783071316.207342:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.207347:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 20 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207357:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 20 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207376:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.207407:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3293:x1869685684461440:12345-0@lo:103: Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.207413:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783071316.207429:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071316.207435:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684461568:12345-0@lo:103: 00010000:00010000:0.0:1783071316.207443:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.207446:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 19 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207454:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 19 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.207472:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.207499:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684461568:12345-0@lo:103: Request processed in 64us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.207505:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071316.207545:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684461568:0@lo:103: 00000100:00100000:0.0:1783071316.207570:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684461440:0@lo:103: 00010000:00010000:3.0:1783071316.208526:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071316.208582:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.208595:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 18 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.208606:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461696:0@lo:104: 00000100:00100000:3.0:1783071316.208643:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071316.208691:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.208699:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 18 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.208708:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461824:0@lo:104: 00000100:00100000:3.0:1783071316.208730:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071316.208748:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.208755:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 18 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.208825:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461952:0@lo:104: 00000100:00100000:3.0:1783071316.208851:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071316.208869:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.208887:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 18 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.208895:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684462080:0@lo:104: 00000100:00100000:3.0:1783071316.208916:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071316.208933:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.208939:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 18 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.208946:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684462208:0@lo:104: 00000100:00100000:3.0:1783071316.208965:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071316.208975:0:8298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071316.209116:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461696 00000100:00100000:0.0:1783071316.209123:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461696 00000100:00100000:0.0:1783071316.209154:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461824 00000100:00100000:0.0:1783071316.209157:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461824 00000100:00100000:0.0:1783071316.209165:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684461952 00000100:00100000:0.0:1783071316.209167:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684461952 00000100:00100000:0.0:1783071316.209175:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462080 00000100:00100000:0.0:1783071316.209178:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462080 00000100:00100000:0.0:1783071316.209187:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462208 00000100:00100000:0.0:1783071316.209189:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462208 00000100:00100000:0.0:1783071316.209212:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071316.209219:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:8298:x1869685684461696:12345-0@lo:104: 00010000:00010000:0.0:1783071316.209231:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209278:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071316.209283:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+8:8298:x1869685684461696:12345-0@lo:104: Request processed in 65us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.209289:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071316.209306:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071316.209312:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+7:8298:x1869685684461824:12345-0@lo:104: 00010000:00010000:0.0:1783071316.209329:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209363:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783071316.209369:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+7:8298:x1869685684461824:12345-0@lo:104: Request processed in 58us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.209375:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071316.209388:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071316.209394:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:8298:x1869685684461952:12345-0@lo:104: 00010000:00010000:0.0:1783071316.209401:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209426:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783071316.209431:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+6:8298:x1869685684461952:12345-0@lo:104: Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.209437:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071316.209448:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071316.209454:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:8298:x1869685684462080:12345-0@lo:104: 00010000:00010000:0.0:1783071316.209461:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209484:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783071316.209488:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:8298:x1869685684462080:12345-0@lo:104: Request processed in 36us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.209494:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071316.209504:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071316.209508:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8298:x1869685684462208:12345-0@lo:104: 00010000:00010000:0.0:1783071316.209521:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209550:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783071316.209555:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8298:x1869685684462208:12345-0@lo:104: Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.209560:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783071316.209576:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783071316.209581:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209588:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.209592:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209600:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.209606:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.209611:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.209631:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209636:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.209652:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209659:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cf800/0xd360fc6ce6ec70d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209697:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783071316.209700:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209705:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.209707:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209714:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.209719:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.209724:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.209737:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209742:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.209754:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209760:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939c00/0xd360fc6ce6ec70c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70d0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209768:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783071316.209771:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209786:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.209788:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209795:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.209802:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.209807:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.209820:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209826:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.209831:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209837:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec70bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec70c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209845:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071316.209848:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209853:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020ce800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.209856:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209871:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.209877:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.209882:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.209894:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209900:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.209905:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209911:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020ce800/0xd360fc6ce6ec7091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7098 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209921:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071316.209924:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209929:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6c00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071316.209931:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209937:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071316.209943:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071316.209955:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783071316.209969:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209974:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071316.209978:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209985:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d6c00/0xd360fc6ce6ec7067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec706e expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.209998:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071316.210000:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071316.210002:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071316.210027:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462336:0@lo:103: 00000100:00100000:0.0:1783071316.210058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.210080:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462848:0@lo:103: 00000100:00100000:0.0:1783071316.210101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.210118:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071316.210124:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462720:0@lo:103: 00000100:00100000:0.0:1783071316.210144:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.210168:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462336 00000100:00100000:0.0:1783071316.210173:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462336 00010000:00010000:0.0:1783071316.210203:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 19 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.210218:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462848 00000100:00100000:0.0:1783071316.210221:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462848 00010000:00010000:0.0:1783071316.210241:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.210252:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462720 00000100:00100000:0.0:1783071316.210255:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462720 00010000:00010000:0.0:1783071316.210264:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 21 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.210276:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071316.210282:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+21:3295:x1869685684462336:12345-0@lo:103: 00010000:00010000:0.0:1783071316.210294:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.210300:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 21 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210310:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 21 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210327:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.210355:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+21:3295:x1869685684462336:12345-0@lo:103: Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.210361:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071316.210373:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071316.210380:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3295:x1869685684462848:12345-0@lo:103: 00010000:00010000:0.0:1783071316.210387:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.210392:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210399:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210421:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.210443:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3295:x1869685684462848:12345-0@lo:103: Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.210449:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071316.210462:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071316.210468:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684462720:12345-0@lo:103: 00010000:00010000:0.0:1783071316.210476:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.210480:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 19 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210488:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 19 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210496:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.210517:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684462720:12345-0@lo:103: Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.210522:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071316.210546:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684462592:0@lo:103: 00000100:00100000:0.0:1783071316.210567:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.210582:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071316.210587:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684462464:0@lo:103: 00000100:00100000:0.0:1783071316.210606:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.210624:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462592 00000100:00100000:0.0:1783071316.210626:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462592 00010000:00010000:0.0:1783071316.210638:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 19 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.210649:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462464 00000100:00100000:0.0:1783071316.210657:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462464 00010000:00010000:0.0:1783071316.210669:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 20 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.210704:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071316.210709:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3293:x1869685684462592:12345-0@lo:103: 00010000:00010000:0.0:1783071316.210718:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.210721:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210729:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210737:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.210763:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3293:x1869685684462592:12345-0@lo:103: Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.210768:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071316.210781:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071316.210786:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684462464:12345-0@lo:103: 00010000:00010000:0.0:1783071316.210794:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071316.210798:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 19 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210806:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 19 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071316.210814:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071316.210835:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684462464:12345-0@lo:103: Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.210841:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071316.210901:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462720:0@lo:103: 00000100:00100000:0.0:1783071316.210911:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462336:0@lo:103: 00000100:00100000:0.0:1783071316.210917:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684462848:0@lo:103: 00000100:00100000:0.0:1783071316.210942:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684462464:0@lo:103: 00000100:00100000:0.0:1783071316.210948:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684462592:0@lo:103: 00010000:00010000:0.0:1783071316.210962:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071316.211037:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c6ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:8298:x1869685684461312:12345-0@lo:104: Request processed in 5402us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.211044:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1783071316.211209:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030c00/0xd360fc6ce6ec7124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec711d expref: 18 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211222:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461184:0@lo:104: 00010000:00010000:3.0:1783071316.211365:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cf400/0xd360fc6ce6ec70fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec70f3 expref: 17 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211375:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461312:0@lo:104: 00010000:00010000:3.0:1783071316.211384:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d7400/0xd360fc6ce6ec70de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec70d7 expref: 16 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211392:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461696:0@lo:104: 00010000:00010000:3.0:1783071316.211401:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec70d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec70c9 expref: 15 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211421:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461824:0@lo:104: 00010000:00010000:3.0:1783071316.211434:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec70c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec70bb expref: 14 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211441:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461952:0@lo:104: 00010000:00010000:3.0:1783071316.211450:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cfa00/0xd360fc6ce6ec7098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7091 expref: 13 pid: 5785 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211457:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684462080:0@lo:104: 00010000:00010000:3.0:1783071316.211465:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cf200/0xd360fc6ce6ec706e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7067 expref: 12 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.211473:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684462208:0@lo:104: 00000100:00100000:0.0:1783071316.216025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071316.216125:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684460928:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071316.216135:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869685684461056:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071316.216179:0:8298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071316.216342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071316.222902:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566848 00000100:00100000:1.0:1783071316.222918:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566848 00010000:00010000:1.0:1783071316.222969:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 10 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071316.223052:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665566976 00000100:00100000:1.0:1783071316.223057:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665566976 00010000:00010000:1.0:1783071316.223071:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 11 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071316.223435:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1783071316.223448:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:2357:x1869685665566848:12345-192.168.202.16@tcp:103: 00010000:00010000:2.0:1783071316.223465:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071316.223472:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 11 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223484:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 11 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223503:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec7139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7cd expref: 11 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223517:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071316.223590:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2357:x1869685665566848:12345-192.168.202.16@tcp:103: Request processed in 145us (7575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.223599:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1783071316.223621:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1783071316.223642:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:2358:x1869685665566976:12345-192.168.202.16@tcp:103: 00010000:00010000:2.0:1783071316.223651:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071316.223656:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223666:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223701:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7c6 expref: 9 pid: 5785 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223712:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223721:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223737:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223745:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223752:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223759:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223765:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071316.223770:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223787:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223801:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071316.223812:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071316.223837:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:2358:x1869685665566976:12345-192.168.202.16@tcp:103: Request processed in 196us (7496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.223844:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00010000:00010000:3.0:1783071316.224040:0:8298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.224161:0:8298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.224169:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec7171 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071316.224298:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071316.225710:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567104 00000100:00100000:3.0:1783071316.225721:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567104 00000100:00100000:3.0:1783071316.225766:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1783071316.225775:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:5569:x1869685665567104:12345-192.168.202.16@tcp:101: 00010000:00010000:3.0:1783071316.225790:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071316.225808:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef0000/0xd360fc6ce6ec7178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca82f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.225836:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef0000/0xd360fc6ce6ec7178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca82f expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.225848:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef0000/0xd360fc6ce6ec7178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca82f expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.225857:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0000, rc 0) 00000100:00100000:3.0:1783071316.225909:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567104:12345-192.168.202.16@tcp:101: Request processed in 136us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071316.225916:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1783071316.236407:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071316.242407:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567232 00000100:00100000:2.0:1783071316.242425:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567232 00000100:00100000:2.0:1783071316.242505:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:2.0:1783071316.242516:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567232:12345-192.168.202.16@tcp:501: 00000100:00100000:2.0:1783071316.242885:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567232:12345-192.168.202.16@tcp:501: Request processed in 368us (6486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.242894:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1783071316.256903:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071316.256945:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567360 00000100:00100000:0.0:1783071316.256954:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567360 00000100:00100000:0.0:1783071316.257003:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:0.0:1783071316.257012:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567360:12345-192.168.202.16@tcp:503: 00000100:00100000:0.0:1783071316.257257:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567360:12345-192.168.202.16@tcp:503: Request processed in 244us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.257266:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:1.0:1783071316.267226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071316.267500:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567488 00000100:00100000:3.0:1783071316.267510:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567488 00000100:00100000:3.0:1783071316.267562:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1783071316.267571:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:6031:x1869685665567488:12345-192.168.202.16@tcp:502: 00000100:00100000:3.0:1783071316.269061:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:6031:x1869685665567488:12345-192.168.202.16@tcp:502: Request processed in 1483us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071316.269086:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1783071316.291864:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071316.291899:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567616 00000100:00100000:3.0:1783071316.291909:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567616 00000100:00100000:3.0:1783071316.291960:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1783071316.291972:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:6031:x1869685665567616:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071316.292260:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:6031:x1869685665567616:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 289us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071316.292268:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:1.0:1783071316.302010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071316.302114:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567744 00000100:00100000:3.0:1783071316.302169:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567744 00000100:00100000:3.0:1783071316.302240:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:3.0:1783071316.302251:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665567744:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071316.302272:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071316.302294:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef0600/0xd360fc6ce6ec717f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca836 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.302325:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef0600/0xd360fc6ce6ec717f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca836 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.302336:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef0600/0xd360fc6ce6ec717f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca836 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071316.302346:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0600, rc 0) 00000100:00100000:3.0:1783071316.302402:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665567744:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 153us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071316.302425:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:3.0:1783071316.305261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071316.310707:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665567872 00000100:00100000:2.0:1783071316.310721:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665567872 00000100:00100000:2.0:1783071316.316438:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1783071316.316469:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665567872:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071316.316956:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665567872:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 502us (11703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071316.316966:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1783071316.704857:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684462976:0@lo:400: 00000100:00100000:2.0:1783071316.705179:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.705247:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684463488:0@lo:400: 00000100:00100000:2.0:1783071316.705273:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.705302:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783071316.705307:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684463104:0@lo:400: 00000100:00100000:2.0:1783071316.705324:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.705340:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684463616:0@lo:400: 00000100:00100000:2.0:1783071316.705379:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071316.705412:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684462976 00000100:00100000:2.0:1783071316.705419:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684462976 00000100:00100000:2.0:1783071316.705461:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783071316.705467:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3292:x1869685684462976:12345-0@lo:400: 00000100:00100000:2.0:1783071316.705508:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3292:x1869685684462976:12345-0@lo:400: Request processed in 41us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.705513:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783071316.705537:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463488 00000100:00100000:2.0:1783071316.705540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463488 00000100:00100000:2.0:1783071316.705561:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463104 00000100:00100000:2.0:1783071316.705563:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463104 00000100:00100000:2.0:1783071316.705574:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071316.705578:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684463488:12345-0@lo:400: 00000100:00100000:2.0:1783071316.705596:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684463488:12345-0@lo:400: Request processed in 19us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.705600:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071316.705607:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071316.705610:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684463104:12345-0@lo:400: 00000100:00100000:2.0:1783071316.705623:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684463104:12345-0@lo:400: Request processed in 13us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.705632:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071316.705647:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463616 00000100:00100000:2.0:1783071316.705649:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463616 00000100:00100000:2.0:1783071316.705666:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071316.705670:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684463616:12345-0@lo:400: 00000100:00100000:2.0:1783071316.705708:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684463616:12345-0@lo:400: Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071316.705712:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1783071316.705725:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071316.706742:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071316.706797:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684463104:0@lo:400: 00010000:00080000:2.0:1783071316.706812:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e26a00 x1869685684463616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071316.706820:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684463616:0@lo:400: 00000100:00100000:2.0:1783071316.706828:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684462976:0@lo:400: 00000100:00100000:2.0:1783071316.706834:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684463488:0@lo:400: 00000100:00100000:0.0:1783071316.708727:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684463232:0@lo:400: 00000100:00100000:0.0:1783071316.708806:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.708839:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684463744:0@lo:13: 00000100:00100000:0.0:1783071316.708865:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.708889:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071316.708896:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684463360:0@lo:400: 00000100:00100000:0.0:1783071316.708918:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071316.708954:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463744 00000100:00100000:0.0:1783071316.708970:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463744 00000100:00100000:0.0:1783071316.709014:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071316.709023:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684463744:12345-0@lo:13: 00002000:00000024:0.0:1783071316.709057:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071316.709096:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684463744:12345-0@lo:13: Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.709103:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071316.709123:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463360 00000100:00100000:0.0:1783071316.709126:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463360 00000100:00100000:0.0:1783071316.709147:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071316.709153:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684463360:12345-0@lo:400: 00000100:00100000:0.0:1783071316.709182:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684463360:12345-0@lo:400: Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.709204:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783071316.709239:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e27480 x1869685684463360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071316.709252:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684463360:0@lo:400: 00010000:00080000:0.0:1783071316.709264:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa369180 x1869685684463744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071316.709276:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684463744:0@lo:13: 00000100:00100000:0.0:1783071316.709301:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684463232 00000100:00100000:0.0:1783071316.709304:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684463232 00000100:00100000:0.0:1783071316.709341:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783071316.709347:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684463232:12345-0@lo:400: 00000100:00100000:0.0:1783071316.709382:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684463232:12345-0@lo:400: Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071316.709396:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1783071316.709417:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071316.709420:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684463232:0@lo:400: 00000020:00000080:0.0:1783071317.069057:0:8350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0cd7f00 20000000:00000080:0.0:1783071317.069075:0:8350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9782c6ac9800 uarg=0000000000000000 20000000:01000000:0.0:1783071317.069108:0:8350:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783071317.069114:0:8350:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783071317.069118:0:8350:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783071317.070400:0:8351:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783071317.070540:0:8350:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1783071317.074126:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1783071317.074184:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1783071317.074257:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1783071317.074274:0:8350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783071317.074295:0:8350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074313:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074321:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074328:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074352:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074359:0:8350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074397:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074413:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 9 pid: 5784 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.074427:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684463872:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071317.074535:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.074543:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 11 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.074551:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464000:0@lo:104: 00000100:00100000:1.0:1783071317.076247:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783071317.076968:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.076984:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 11 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.076997:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464128:0@lo:104: 00000100:00100000:1.0:1783071317.077044:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783071317.077159:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.077168:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 11 pid: 5785 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.077177:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464256:0@lo:104: 00000100:00100000:1.0:1783071317.077209:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.077365:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783071317.077384:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.077443:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464000 00000100:00100000:2.0:1783071317.077450:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464000 00000100:00100000:2.0:1783071317.077487:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464128 00000100:00100000:2.0:1783071317.077490:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464128 00000100:00100000:2.0:1783071317.077499:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464256 00000100:00100000:2.0:1783071317.077501:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464256 00000100:00100000:2.0:1783071317.077512:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071317.077519:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:8350:x1869685684464000:12345-0@lo:104: 00010000:00010000:2.0:1783071317.077536:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077617:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071317.077623:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+5:8350:x1869685684464000:12345-0@lo:104: Request processed in 104us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.077630:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783071317.077647:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071317.077653:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4077850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8350:x1869685684464128:12345-0@lo:104: 00010000:00010000:2.0:1783071317.077660:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077717:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783071317.077722:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4077850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:8350:x1869685684464128:12345-0@lo:104: Request processed in 70us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.077727:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071317.077757:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071317.077763:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:8350:x1869685684464256:12345-0@lo:104: 00010000:00010000:2.0:1783071317.077771:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077796:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783071317.077801:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:8350:x1869685684464256:12345-0@lo:104: Request processed in 38us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.077806:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783071317.077822:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783071317.077827:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077840:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071317.077844:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077852:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071317.077858:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.077863:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071317.077890:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077896:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071317.077912:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077919:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939800/0xd360fc6ce6ec7083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec708a expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077932:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071317.077935:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077941:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071317.077943:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077960:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071317.077965:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.077970:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071317.077983:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.077988:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071317.078002:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078009:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec7021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7028 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078018:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071317.078021:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078027:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cee00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071317.078029:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078035:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071317.078041:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.078053:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071317.078065:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078071:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071317.078076:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078081:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cee00/0xd360fc6ce6ec6faa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec6fb1 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078093:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071317.078095:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071317.078097:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071317.078103:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071317.078113:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684464384:0@lo:103: 00000100:00100000:2.0:1783071317.078143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.078197:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684464512:0@lo:103: 00000100:00100000:2.0:1783071317.078220:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.078238:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071317.078243:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684464640:0@lo:103: 00000100:00100000:2.0:1783071317.078262:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.078288:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464384 00000100:00100000:2.0:1783071317.078291:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464384 00010000:00010000:2.0:1783071317.078309:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 12 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.078323:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464512 00000100:00100000:2.0:1783071317.078330:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464512 00010000:00010000:2.0:1783071317.078342:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 13 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.078353:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464640 00000100:00100000:2.0:1783071317.078355:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464640 00010000:00010000:2.0:1783071317.078364:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 14 pid: 5785 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.078376:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071317.078381:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:3295:x1869685684464384:12345-0@lo:103: 00010000:00010000:2.0:1783071317.078392:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071317.078396:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 14 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078405:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 14 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078423:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071317.078453:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:3295:x1869685684464384:12345-0@lo:103: Request processed in 71us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.078459:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071317.078472:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071317.078478:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3292:x1869685684464512:12345-0@lo:103: 00010000:00010000:2.0:1783071317.078486:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071317.078490:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 13 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078498:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 13 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078518:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071317.078543:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:3292:x1869685684464512:12345-0@lo:103: Request processed in 65us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.078550:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071317.078563:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071317.078568:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3292:x1869685684464640:12345-0@lo:103: 00010000:00010000:2.0:1783071317.078576:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071317.078580:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 12 pid: 5785 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078587:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 12 pid: 5785 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.078595:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071317.078615:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:3292:x1869685684464640:12345-0@lo:103: Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.078620:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783071317.078653:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684464384:0@lo:103: 00000100:00100000:2.0:1783071317.078705:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684464640:0@lo:103: 00000100:00100000:2.0:1783071317.078713:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684464512:0@lo:103: 00010000:00010000:1.0:1783071317.078902:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938e00/0xd360fc6ce6ec708a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7083 expref: 11 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.078913:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464000:0@lo:104: 00010000:00010000:1.0:1783071317.078922:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec7028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7021 expref: 10 pid: 5783 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.078929:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464128:0@lo:104: 00010000:00010000:1.0:1783071317.078936:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec6fb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec6faa expref: 9 pid: 5785 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.078944:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684464256:0@lo:104: 00000100:00100000:1.0:1783071317.080964:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071317.081058:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869685684463872:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071317.081090:0:8350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.081466:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568000 00000100:00100000:2.0:1783071317.081473:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568000 00010000:00010000:2.0:1783071317.081506:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.082150:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1783071317.082172:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2358:x1869685665568000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071317.082213:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071317.082221:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082233:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082251:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7fe expref: 10 pid: 5784 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082268:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082276:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082292:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082299:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082306:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082314:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082320:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071317.082330:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082344:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082366:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.082384:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071317.082432:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:2358:x1869685665568000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 262us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.082439:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00010000:00010000:1.0:1783071317.082779:0:8350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.082789:0:8350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.082795:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d6c00/0xd360fc6ce6ec7186 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.153010:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071317.384759:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783071317.385716:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c7f0f800 from 39 10000000:01000000:0.0:1783071317.385722:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071317.385844:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.385858:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.385997:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071317.386023:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684464768:0@lo:101: 00000100:00100000:0.0:1783071317.386096:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.386156:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.386253:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464768 00000100:00100000:2.0:1783071317.386260:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464768 00000100:00100000:2.0:1783071317.386310:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783071317.386319:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+9:5788:x1869685684464768:12345-0@lo:101: 00010000:00010000:2.0:1783071317.386332:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071317.386345:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec718d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.386368:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec718d expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.386379:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec718d expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.386387:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939400, rc 0) 00000100:00100000:2.0:1783071317.387264:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684464768:12345-0@lo:101: Request processed in 941us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.387291:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783071317.387407:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684464768:0@lo:101: 00010000:00010000:0.0:1783071317.387434:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.387445:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071317.387511:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684464896:0@lo:501: 00000100:00100000:0.0:1783071317.387547:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.387619:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.387656:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684464896 00000100:00100000:2.0:1783071317.387661:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684464896 00000100:00100000:2.0:1783071317.388019:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783071317.388029:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684464896:12345-0@lo:501: 00000100:00100000:2.0:1783071317.388298:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684464896:12345-0@lo:501: Request processed in 270us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.388306:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783071317.388374:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684464896:0@lo:501: 00000100:00100000:0.0:1783071317.388407:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465024:0@lo:503: 00000100:00100000:0.0:1783071317.388447:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.389456:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.389536:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465024 00000100:00100000:1.0:1783071317.389544:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465024 00000100:00100000:1.0:1783071317.389579:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783071317.389587:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684465024:12345-0@lo:503: 00000100:00100000:1.0:1783071317.389758:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684465024:12345-0@lo:503: Request processed in 172us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.389769:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783071317.390008:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465024:0@lo:503: 00000100:00100000:0.0:1783071317.390541:0:8363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8363:1869685684465152:0@lo:502: 00000100:00100000:0.0:1783071317.390583:0:8363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.390613:0:8363:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.390663:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465152 00000100:00100000:1.0:1783071317.390667:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465152 00000100:00100000:1.0:1783071317.390713:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783071317.390719:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:8363:x1869685684465152:12345-0@lo:502: 00000100:00100000:1.0:1783071317.391060:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:8363:x1869685684465152:12345-0@lo:502: Request processed in 339us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.391067:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783071317.391158:0:8363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8363:1869685684465152:0@lo:502: 00000100:00100000:0.0:1783071317.391207:0:8363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8363:1869685684465280:0@lo:502: 00000100:00100000:0.0:1783071317.391238:0:8363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.391263:0:8363:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.391407:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465280 00000100:00100000:1.0:1783071317.391412:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465280 00000100:00100000:1.0:1783071317.391432:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783071317.391437:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:8363:x1869685684465280:12345-0@lo:502: 00000100:00100000:1.0:1783071317.391587:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:8363:x1869685684465280:12345-0@lo:502: Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.391594:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783071317.391751:0:8363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8363:1869685684465280:0@lo:502: 00000040:00080000:0.0:1783071317.391780:0:8363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783071317.392053:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783071317.392070:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783071317.392079:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.392102:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071317.392112:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783071317.392115:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783071317.392118:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071317.392143:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.392151:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.392159:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.392176:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465408:0@lo:101: 00000100:00100000:1.0:1783071317.392216:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.392256:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.392440:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465408 00000100:00100000:0.0:1783071317.392445:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465408 00000100:00100000:0.0:1783071317.392486:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783071317.392493:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+10:5788:x1869685684465408:12345-0@lo:101: 00010000:00010000:0.0:1783071317.392503:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071317.392515:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec71a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec719b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.392538:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec71a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec719b expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.392548:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec71a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec719b expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.392556:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030000, rc 0) 00000100:00100000:0.0:1783071317.392594:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684465408:12345-0@lo:101: Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.392600:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783071317.393237:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465408:0@lo:101: 00010000:00010000:1.0:1783071317.393254:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.393263:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.393316:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465536:0@lo:501: 00000100:00100000:1.0:1783071317.393346:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.393381:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.393466:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465536 00000100:00100000:0.0:1783071317.393471:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465536 00000100:00100000:0.0:1783071317.393509:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783071317.393515:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684465536:12345-0@lo:501: 00000100:00100000:0.0:1783071317.395039:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684465536:12345-0@lo:501: Request processed in 1518us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.395052:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783071317.395285:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465536:0@lo:501: 00000100:00100000:3.0:1783071317.395333:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465664:0@lo:503: 00000100:00100000:3.0:1783071317.395383:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.395419:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.395596:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465664 00000100:00100000:0.0:1783071317.395602:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465664 00000100:00100000:0.0:1783071317.395642:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783071317.395649:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684465664:12345-0@lo:503: 00000100:00100000:0.0:1783071317.395850:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684465664:12345-0@lo:503: Request processed in 201us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.395863:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071317.396075:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684465664:0@lo:503: 00000100:00100000:3.0:1783071317.396602:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8364:1869685684465792:0@lo:502: 00000100:00100000:3.0:1783071317.396640:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.396889:0:8364:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.396982:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465792 00000100:00100000:0.0:1783071317.396987:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465792 00000100:00100000:0.0:1783071317.397057:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071317.397064:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:8364:x1869685684465792:12345-0@lo:502: 00000100:00100000:0.0:1783071317.397232:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:8364:x1869685684465792:12345-0@lo:502: Request processed in 168us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.397239:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783071317.397309:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8364:1869685684465792:0@lo:502: 00000020:01000000:1.0:1783071317.397334:0:8364:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071317.397344:0:8364:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.397346:0:8364:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071317.397352:0:8364:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071317.397375:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8364:1869685684465920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.397410:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.397491:0:8364:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.397609:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684465920 00000100:00100000:3.0:1783071317.397613:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684465920 00000100:00100000:3.0:1783071317.397635:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783071317.397641:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:8364:x1869685684465920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.397802:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:8364:x1869685684465920:12345-0@lo:502:llog_process_th.0 Request processed in 159us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.397808:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783071317.397888:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8364:1869685684465920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071317.397907:0:8364:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071317.397911:0:8364:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.397913:0:8364:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071317.397917:0:8364:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783071317.398177:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1783071317.398204:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783071317.398216:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.398227:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071317.398247:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071317.398250:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0f800 from 4 10000000:01000000:3.0:1783071317.398253:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071317.398279:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.398287:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.398296:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.398310:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.398338:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.398366:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.398409:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466048 00000100:00100000:1.0:1783071317.398414:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466048 00000100:00100000:1.0:1783071317.398434:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783071317.398440:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+11:5788:x1869685684466048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071317.398448:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071317.398461:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71a9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.398490:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.398500:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.398509:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7000, rc 0) 00000100:00100000:1.0:1783071317.398552:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.398557:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783071317.398702:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071317.398714:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.398723:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.398773:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.398798:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.398813:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.399103:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466176 00000100:00100000:1.0:1783071317.399108:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466176 00000100:00100000:1.0:1783071317.399127:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783071317.399132:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.399365:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.399372:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783071317.399446:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.399484:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.399525:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.399552:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.399639:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466304 00000100:00100000:1.0:1783071317.399644:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466304 00000100:00100000:1.0:1783071317.399661:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783071317.399667:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.399835:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.399841:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783071317.400056:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.400406:0:8365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8365:1869685684466432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.400442:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.400468:0:8365:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.400541:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466432 00000100:00100000:1.0:1783071317.400545:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466432 00000100:00100000:1.0:1783071317.400564:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783071317.400570:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:8365:x1869685684466432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.400715:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:8365:x1869685684466432:12345-0@lo:502:llog_process_th.0 Request processed in 145us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.400722:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783071317.400846:0:8365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8365:1869685684466432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071317.400866:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071317.400944:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071317.400946:0:8365:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071317.400954:0:8365:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c7f0f800 00000020:00000080:3.0:1783071317.400956:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071317.401030:0:8365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8365:1869685684466560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.401062:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.401074:0:8365:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.401217:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466560 00000100:00100000:0.0:1783071317.401221:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466560 00000100:00100000:0.0:1783071317.401244:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783071317.401250:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:8365:x1869685684466560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071317.401372:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:8365:x1869685684466560:12345-0@lo:502:llog_process_th.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.401379:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783071317.401956:0:8365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8365:1869685684466560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071317.401983:0:8365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071317.401989:0:8365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071317.401990:0:8365:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783071317.401995:0:8365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783071317.403002:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783071317.403027:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071317.403038:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403052:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071317.403064:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783071317.403066:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782f9bac800 from 39 10000000:01000000:0.0:1783071317.403069:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783071317.403105:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403124:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403134:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071317.403157:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.403224:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.403266:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.403285:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466688 00000100:00100000:0.0:1783071317.403290:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466688 00000100:00100000:0.0:1783071317.403321:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783071317.403328:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+12:5788:x1869685684466688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071317.403339:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071317.403350:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030600/0xd360fc6ce6ec71be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403372:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030600/0xd360fc6ce6ec71be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71b7 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403382:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030600/0xd360fc6ce6ec71be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71b7 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.403390:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030600, rc 0) 00000100:00100000:0.0:1783071317.403424:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684466688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.403431:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783071317.404845:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071317.404964:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.404977:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071317.405042:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.405089:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.405126:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.405563:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466816 00000100:00100000:2.0:1783071317.405570:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466816 00000100:00100000:2.0:1783071317.405614:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783071317.405622:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684466816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.406099:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684466816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 476us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.406107:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783071317.406158:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.406217:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.406264:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.406284:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.406328:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684466944 00000100:00100000:0.0:1783071317.406333:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684466944 00000100:00100000:0.0:1783071317.406363:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783071317.406370:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684466944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.409288:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684466944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2911us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.409304:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783071317.413912:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684466944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.414665:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8367:1869685684467072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.419143:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.419212:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.419269:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467072 00000100:00100000:1.0:1783071317.419278:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467072 00000100:00100000:1.0:1783071317.419332:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783071317.419348:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:8367:x1869685684467072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.419606:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:8367:x1869685684467072:12345-0@lo:502:llog_process_th.0 Request processed in 259us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.419614:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783071317.419945:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8367:1869685684467072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.420017:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8367:1869685684467200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.420052:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.420081:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467200 00000100:00100000:2.0:1783071317.420085:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467200 00000100:00100000:2.0:1783071317.420117:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783071317.420124:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:8367:x1869685684467200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.420264:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:8367:x1869685684467200:12345-0@lo:502:llog_process_th.0 Request processed in 140us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.420271:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783071317.420305:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.420316:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8367:1869685684467200:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783071317.420334:0:8367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783071317.420395:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783071317.420413:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071317.420422:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.420434:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.420444:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783071317.420446:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783071317.420449:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783071317.421565:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.421582:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.421593:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.421626:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.422565:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.422617:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.422640:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467328 00000100:00100000:2.0:1783071317.422646:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467328 00000100:00100000:2.0:1783071317.422702:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783071317.422712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+13:5788:x1869685684467328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071317.422726:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071317.422742:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec71cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71c5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.422928:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec71cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71c5 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.422940:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec71cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71c5 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.422950:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939800, rc 0) 00000100:00100000:2.0:1783071317.423005:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.423011:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783071317.423061:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071317.423077:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.423085:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.423447:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.423495:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.423515:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.432171:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467456 00000100:00100000:2.0:1783071317.432193:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467456 00000100:00100000:2.0:1783071317.432253:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783071317.432263:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.432588:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (9091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.432596:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783071317.432647:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.432714:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.432758:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.432799:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.432812:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467584 00000100:00100000:2.0:1783071317.432816:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467584 00000100:00100000:2.0:1783071317.432838:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783071317.432844:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.433355:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 510us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.433362:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783071317.433405:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.437400:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8369:1869685684467712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.437546:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.437623:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.437658:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467712 00000100:00100000:2.0:1783071317.438269:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467712 00000100:00100000:2.0:1783071317.438365:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783071317.438375:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8369:x1869685684467712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.438741:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8369:x1869685684467712:12345-0@lo:502:llog_process_th.0 Request processed in 366us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.438749:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783071317.438892:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8369:1869685684467712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071317.438926:0:8369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071317.438935:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071317.438938:0:8369:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783071317.438944:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783071317.438972:0:8369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8369:1869685684467840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.439013:0:8369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.439208:0:8369:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.439331:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467840 00000100:00100000:2.0:1783071317.439336:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467840 00000100:00100000:2.0:1783071317.439358:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783071317.439365:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8369:x1869685684467840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.439513:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:8369:x1869685684467840:12345-0@lo:502:llog_process_th.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.439521:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783071317.439813:0:8369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8369:1869685684467840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071317.439835:0:8369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071317.439840:0:8369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071317.439842:0:8369:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783071317.439846:0:8369:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783071317.440123:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783071317.440142:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783071317.440154:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.440166:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.440176:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071317.440179:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782f9bac800 from 4 10000000:01000000:2.0:1783071317.440190:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071317.440222:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.440237:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.440260:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.440278:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.440312:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.440348:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.440441:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684467968 00000100:00100000:3.0:1783071317.440447:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684467968 00000100:00100000:3.0:1783071317.440526:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783071317.440535:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:5788:x1869685684467968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071317.440545:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071317.440556:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.440576:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.440585:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.440592:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1200, rc 0) 00000100:00100000:3.0:1783071317.440638:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684467968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.440644:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783071317.440929:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684467968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071317.440942:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.440950:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.440994:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.441019:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.441047:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.441152:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468096 00000100:00100000:3.0:1783071317.441156:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468096 00000100:00100000:3.0:1783071317.441219:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783071317.441226:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684468096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.441494:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684468096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.441500:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783071317.441903:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.441942:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.441978:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.442001:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.442100:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468224 00000100:00100000:3.0:1783071317.442105:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468224 00000100:00100000:3.0:1783071317.442125:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783071317.442131:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684468224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.442300:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684468224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.442307:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783071317.442470:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.444055:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8370:1869685684468352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.444129:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.444193:0:8370:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.444242:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468352 00000100:00100000:3.0:1783071317.444249:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468352 00000100:00100000:3.0:1783071317.444294:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783071317.444302:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8370:x1869685684468352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.444501:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8370:x1869685684468352:12345-0@lo:502:llog_process_th.0 Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.444508:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783071317.444665:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8370:1869685684468352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071317.444719:0:8370:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071317.444730:0:8370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071317.444732:0:8370:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783071317.444740:0:8370:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782f9bac800 00000020:00000080:2.0:1783071317.444743:0:8370:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783071317.445370:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8370:1869685684468480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.445423:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.445454:0:8370:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.448197:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468480 00000100:00100000:3.0:1783071317.448213:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468480 00000100:00100000:3.0:1783071317.448281:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783071317.448300:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8370:x1869685684468480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.448586:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:8370:x1869685684468480:12345-0@lo:502:llog_process_th.0 Request processed in 288us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.448594:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783071317.448876:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8370:1869685684468480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783071317.448907:0:8370:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071317.448916:0:8370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071317.448918:0:8370:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783071317.448927:0:8370:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783071317.449259:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783071317.449277:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071317.449288:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.449298:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071317.449308:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783071317.449310:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c8344000 from 39 10000000:01000000:3.0:1783071317.449313:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071317.449343:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.449352:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.449361:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.449381:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.449418:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.449452:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b600 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.449584:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468608 00000100:00100000:1.0:1783071317.449590:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468608 00000100:00100000:1.0:1783071317.449649:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783071317.449657:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:5788:x1869685684468608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071317.449667:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071317.449696:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec71e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.449717:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec71e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71e1 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.449727:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec71e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71e1 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.449751:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7800, rc 0) 00000100:00100000:1.0:1783071317.449951:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684468608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.449958:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783071317.450256:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071317.450270:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.450284:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.450333:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.450358:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.450387:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.450400:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468736 00000100:00100000:3.0:1783071317.450403:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468736 00000100:00100000:3.0:1783071317.450422:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783071317.450428:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684468736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.450650:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684468736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.450656:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783071317.450688:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.450715:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.450866:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.450923:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.450961:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468864 00000100:00100000:3.0:1783071317.450965:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468864 00000100:00100000:3.0:1783071317.450993:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783071317.451000:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684468864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.451177:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684468864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.451196:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783071317.451452:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684468864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.451995:0:8372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8372:1869685684468992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071317.452031:0:8372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.452063:0:8372:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783071317.452073:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684468992 00000100:00100000:1.0:1783071317.452079:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684468992 00000100:00100000:1.0:1783071317.452116:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783071317.452123:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8372:x1869685684468992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.452719:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8372:x1869685684468992:12345-0@lo:502:llog_process_th.0 Request processed in 594us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.452727:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783071317.452736:0:8372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8372:1869685684468992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071317.452803:0:8372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8372:1869685684469120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071317.452836:0:8372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071317.452860:0:8372:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.453055:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469120 00000100:00100000:3.0:1783071317.453060:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469120 00000100:00100000:3.0:1783071317.453247:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783071317.453256:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8372:x1869685684469120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.453603:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:8372:x1869685684469120:12345-0@lo:502:llog_process_th.0 Request processed in 348us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.453616:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783071317.454024:0:8372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8372:1869685684469120:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783071317.454050:0:8372:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783071317.454244:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783071317.454265:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783071317.454276:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.454287:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071317.454296:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783071317.454298:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783071317.454301:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783071317.454342:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.454350:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.454359:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.454386:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.454421:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.454624:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.454917:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469248 00000100:00100000:0.0:1783071317.454924:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469248 00000100:00100000:0.0:1783071317.454970:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783071317.454978:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684469248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071317.454991:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071317.455006:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec71f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71ef expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.455032:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec71f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71ef expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.455043:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec71f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71ef expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.455052:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031400, rc 0) 00000100:00100000:0.0:1783071317.455092:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.455098:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783071317.455116:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071317.455130:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.455138:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.455313:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.455452:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.455553:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9180 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.455602:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469376 00000100:00100000:3.0:1783071317.455607:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469376 00000100:00100000:3.0:1783071317.455640:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783071317.455648:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.461487:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5830us (6025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.461501:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783071317.461941:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.461997:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.462042:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.462088:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.462230:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469504 00000100:00100000:2.0:1783071317.462237:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469504 00000100:00100000:2.0:1783071317.462287:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783071317.462297:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.462639:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.462647:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783071317.463646:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.464069:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8374:1869685684469632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.464125:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.464338:0:8374:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071317.464465:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469632 00000100:00100000:2.0:1783071317.464571:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469632 00000100:00100000:2.0:1783071317.464643:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783071317.464653:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:8374:x1869685684469632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071317.464931:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:8374:x1869685684469632:12345-0@lo:502:llog_process_th.0 Request processed in 278us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.464938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783071317.465013:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8374:1869685684469632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071317.465038:0:8374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071317.465047:0:8374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.465050:0:8374:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071317.465056:0:8374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071317.465079:0:8374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8374:1869685684469760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.465118:0:8374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.465144:0:8374:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.465152:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469760 00000100:00100000:0.0:1783071317.465371:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469760 00000100:00100000:0.0:1783071317.465405:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783071317.465412:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:8374:x1869685684469760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071317.465738:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:8374:x1869685684469760:12345-0@lo:502:llog_process_th.0 Request processed in 325us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.465744:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783071317.467150:0:8374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8374:1869685684469760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071317.467210:0:8374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071317.467219:0:8374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.467221:0:8374:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071317.467227:0:8374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783071317.467407:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1783071317.467424:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071317.467435:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.467458:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071317.467469:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071317.467483:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c8344000 from 4 10000000:01000000:2.0:1783071317.467487:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071317.467518:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.467527:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.467536:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071317.467556:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.467605:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071317.467645:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2e400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.467712:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684469888 00000100:00100000:3.0:1783071317.467718:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684469888 00000100:00100000:3.0:1783071317.467762:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783071317.467772:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684469888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071317.467793:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071317.467806:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec71fd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.467828:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.467839:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.467847:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0c00, rc 0) 00000100:00100000:3.0:1783071317.467881:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684469888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.467887:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783071317.468021:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684469888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071317.468034:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071317.468043:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071317.468085:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.468108:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.468134:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.468974:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470016 00000100:00100000:3.0:1783071317.468988:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470016 00000100:00100000:3.0:1783071317.469027:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783071317.469035:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684470016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.469611:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684470016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.469620:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783071317.472651:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.472884:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.472958:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.473042:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.473084:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470144 00000100:00100000:3.0:1783071317.473090:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470144 00000100:00100000:3.0:1783071317.473172:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783071317.473192:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684470144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.473621:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684470144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.473629:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783071317.479167:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071317.479980:0:8375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8375:1869685684470272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.480060:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.480106:0:8375:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.480219:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470272 00000100:00100000:3.0:1783071317.480226:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470272 00000100:00100000:3.0:1783071317.480278:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783071317.480289:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8375:x1869685684470272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.480527:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8375:x1869685684470272:12345-0@lo:502:llog_process_th.0 Request processed in 239us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.480536:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783071317.480550:0:8375:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8375:1869685684470272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071317.480580:0:8375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071317.480591:0:8375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071317.480593:0:8375:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783071317.480600:0:8375:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c8344000 00000020:00000080:1.0:1783071317.480603:0:8375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783071317.480702:0:8375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8375:1869685684470400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071317.480735:0:8375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071317.480751:0:8375:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782d07e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071317.482195:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470400 00000100:00100000:3.0:1783071317.482208:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470400 00000100:00100000:3.0:1783071317.482259:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783071317.482268:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8375:x1869685684470400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071317.482493:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:8375:x1869685684470400:12345-0@lo:502:llog_process_th.0 Request processed in 225us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.482506:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783071317.482539:0:8375:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:8375:1869685684470400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071317.482568:0:8375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071317.482575:0:8375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071317.482577:0:8375:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783071317.482581:0:8375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783071317.483499:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783071317.483522:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071317.483533:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.483544:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071317.483554:0:5788:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783071317.483557:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9782c5bbb380 from 1 10000000:01000000:3.0:1783071317.483559:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783071317.483590:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.483598:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.483606:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.483626:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.483669:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.483739:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.483908:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470528 00000100:00100000:0.0:1783071317.483915:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470528 00000100:00100000:0.0:1783071317.483955:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783071317.483961:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684470528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071317.483973:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071317.483985:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec720b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.484008:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec720b expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.484017:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec720b expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071317.484025:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031000, rc 0) 00000100:00100000:0.0:1783071317.484058:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684470528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.484063:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783071317.484199:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071317.484212:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.484221:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.484276:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071317.484300:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071317.484329:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071317.484373:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470656 00000100:00100000:0.0:1783071317.484378:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470656 00000100:00100000:0.0:1783071317.484405:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783071317.484411:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684470656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.484908:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684470656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (605us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071317.484924:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783071317.486129:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684470656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783071317.486198:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783071317.486209:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071317.486220:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071317.952076:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071317.952572:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568128 00000100:00100000:0.0:1783071317.952585:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568128 00000100:00100000:0.0:1783071317.952642:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1783071317.952653:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:5569:x1869685665568128:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071317.952669:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071317.952719:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca83d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.952817:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.952831:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071317.952840:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030a00, rc 0) 00000100:00100000:3.0:1783071317.952890:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665568128:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 239us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071317.952896:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:1.0:1783071317.964615:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071317.964711:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568256 00000100:00100000:0.0:1783071317.964721:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568256 00000100:00100000:0.0:1783071317.964772:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:0.0:1783071317.964782:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665568256:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071317.965051:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665568256:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 269us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071317.965059:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:0.0:1783071317.978722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071317.978811:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568384 00000100:00100000:2.0:1783071317.978820:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568384 00000100:00100000:2.0:1783071317.978878:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:2.0:1783071317.978887:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665568384:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071317.979103:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:5569:x1869685665568384:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 217us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071317.979111:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:2.0:1783071317.989052:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071317.989534:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568512 00000100:00100000:1.0:1783071317.989545:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568512 00000100:00100000:1.0:1783071317.989601:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:1.0:1783071317.989609:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:6089:x1869685665568512:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783071317.989862:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:6089:x1869685665568512:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 252us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071317.989871:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:0.0:1783071318.009870:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071318.009962:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568640 00000100:00100000:3.0:1783071318.009974:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568640 00000100:00100000:3.0:1783071318.010041:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:3.0:1783071318.010052:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:6089:x1869685665568640:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071318.010325:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:6089:x1869685665568640:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 274us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071318.010334:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00010000:00010000:2.0:1783071318.176952:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071319.205117:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071319.488320:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071319.488374:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071319.488420:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071319.488472:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071319.488510:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569152 00000100:00100000:3.0:1783071319.488522:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569152 00000100:00100000:3.0:1783071319.488577:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569024 00000100:00100000:3.0:1783071319.488580:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569024 00000100:00100000:3.0:1783071319.488600:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1783071319.488610:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071319.488711:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568768 00000100:00100000:3.0:1783071319.488714:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071319.488717:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568768 00000100:00100000:3.0:1783071319.488726:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1783071319.488746:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071319.488756:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071319.488761:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:1.0:1783071319.488772:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665568768:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071319.488784:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071319.488790:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1783071319.488808:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665568768:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071319.488816:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:2.0:1783071319.488949:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665568896 00000100:00100000:2.0:1783071319.488954:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665568896 00000100:00100000:2.0:1783071319.488994:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1783071319.489001:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665568896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071319.489043:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665568896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 42us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071319.489049:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:2.0:1783071319.489065:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071319.489070:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071319.489072:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783071320.224862:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071321.254971:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071321.313720:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071321.313747:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684470784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071321.313832:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071321.314755:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470784 00000100:00100000:3.0:1783071321.314775:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470784 00000100:00100000:3.0:1783071321.314836:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783071321.314847:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684470784:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783071321.314869:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1783071321.314887:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071321.314953:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684470784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071321.314961:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1783071321.314983:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcce00 x1869685684470784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071321.315004:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684470784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071321.826130:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684470912:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826272:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684471424:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826325:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071321.826337:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684471296:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826387:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684471040:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826408:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826426:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684471552:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826444:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826461:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071321.826466:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684471168:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826484:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071321.826513:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471424 00000100:00100000:2.0:1783071321.826521:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471424 00000100:00100000:2.0:1783071321.826569:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471040 00000100:00100000:2.0:1783071321.826572:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471040 00000100:00100000:2.0:1783071321.826582:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471168 00000100:00100000:2.0:1783071321.826585:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471168 00000100:00100000:2.0:1783071321.826599:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783071321.826607:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826657:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684471424:12345-0@lo:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071321.826663:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783071321.826712:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071321.826719:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684471040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826750:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684471040:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071321.826755:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071321.826767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071321.826773:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684471168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826807:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684471168:12345-0@lo:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071321.826812:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071321.826830:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471296 00000100:00100000:2.0:1783071321.826834:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471296 00000100:00100000:2.0:1783071321.826855:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471552 00000100:00100000:2.0:1783071321.826858:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471552 00000100:00100000:2.0:1783071321.826871:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071321.826876:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826906:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684471296:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071321.826912:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071321.826921:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071321.826927:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684471552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.826950:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684471552:12345-0@lo:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071321.826956:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783071321.826977:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071321.826982:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783071321.827007:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d58380 x1869685684471296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071321.827020:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684471296:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.827030:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684471424:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.827054:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684471168:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.827063:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684471040:0@lo:400:kworker.0 00010000:00080000:2.0:1783071321.827079:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d5b100 x1869685684471552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071321.827088:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684471552:0@lo:400:kworker.0 00000100:00100000:2.0:1783071321.827529:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684471680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071321.827559:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071321.827776:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684470912 00000100:00100000:3.0:1783071321.827782:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684470912 00000100:00100000:3.0:1783071321.827850:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783071321.827858:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684470912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071321.827903:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684470912:12345-0@lo:400:kworker.0 Request processed in 47us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071321.827910:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783071321.828116:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684470912:0@lo:400:kworker.0 00000100:00100000:1.0:1783071321.828224:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471680 00000100:00100000:1.0:1783071321.828229:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471680 00000100:00100000:1.0:1783071321.828261:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071321.828268:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684471680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071321.828296:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071321.828340:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684471680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071321.828345:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783071321.828407:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa36ad80 x1869685684471680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071321.828423:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684471680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783071322.278904:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071323.306593:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071323.700460:0:8659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1783071324.322114:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071324.609622:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071324.609658:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071324.609721:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071324.609748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071324.609777:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569664 00000100:00100000:3.0:1783071324.609787:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569664 00000100:00100000:3.0:1783071324.609843:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569536 00000100:00100000:3.0:1783071324.609848:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569536 00000100:00100000:3.0:1783071324.609867:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1783071324.609875:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071324.610062:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783071324.610072:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783071324.610087:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569280 00000100:00100000:1.0:1783071324.610090:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569280 00000100:00100000:1.0:1783071324.610114:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:1.0:1783071324.610147:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665569280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071324.610211:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 336us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071324.610219:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1783071324.610235:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1783071324.610241:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071324.611037:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569408 00000100:00100000:0.0:1783071324.611044:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569408 00000100:00100000:0.0:1783071324.611087:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1783071324.611095:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665569408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071324.614347:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665569280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 4214us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071324.614361:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1783071324.615041:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665569536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 4796us (5288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071324.615052:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00080000:3.0:1783071324.615077:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071324.615082:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071324.615085:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071324.620787:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665569408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 9672us (11154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071324.620800:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00010000:00010000:1.0:1783071325.345416:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071326.370912:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071326.434238:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684471808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071326.434382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071326.437485:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471808 00000100:00100000:1.0:1783071326.437499:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471808 00000100:00100000:1.0:1783071326.437568:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071326.437589:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684471808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071326.437626:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783071326.437898:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071326.444069:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684471808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6473us (9676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071326.444086:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783071326.446331:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcdc00 x1869685684471808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071326.446364:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684471808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071326.946314:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071326.946338:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684471936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071326.946414:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071326.946577:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684471936 00000100:00100000:2.0:1783071326.946585:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684471936 00000100:00100000:2.0:1783071326.946651:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783071326.946661:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684471936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071326.946719:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071326.946766:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684471936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071326.946773:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783071326.946814:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa36b100 x1869685684471936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071326.946831:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684471936:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783071326.947068:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071326.947786:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684472192:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.947825:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071326.947851:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783071326.947856:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684472064:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.947883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071326.948410:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684472576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.948438:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071326.948505:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684472448:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.948531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071326.948552:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071326.948557:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684472320:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.948591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071326.948618:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472192 00000100:00100000:3.0:1783071326.948624:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472192 00000100:00100000:3.0:1783071326.948660:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472576 00000100:00100000:3.0:1783071326.948663:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472576 00000100:00100000:3.0:1783071326.948708:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472320 00000100:00100000:3.0:1783071326.948711:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472320 00000100:00100000:3.0:1783071326.948731:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071326.948737:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684472192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.948783:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684472192:12345-0@lo:400:kworker.0 Request processed in 45us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071326.948789:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071326.948806:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071326.948812:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.948836:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684472576:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071326.948858:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071326.948872:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071326.948878:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949071:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684472320:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071326.949078:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783071326.949100:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472064 00000100:00100000:3.0:1783071326.949103:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472064 00000100:00100000:3.0:1783071326.949137:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783071326.949143:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684472064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949242:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684472064:12345-0@lo:400:kworker.0 Request processed in 99us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071326.949248:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783071326.949278:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472448 00000100:00100000:3.0:1783071326.949282:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472448 00000100:00100000:3.0:1783071326.949304:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071326.949310:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949337:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684472448:12345-0@lo:400:kworker.0 Request processed in 28us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071326.949344:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071326.949385:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684472320:0@lo:400:kworker.0 00010000:00080000:3.0:1783071326.949400:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcce00 x1869685684472448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071326.949410:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684472448:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949440:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684472064:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949460:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684472576:0@lo:400:kworker.0 00000100:00100000:3.0:1783071326.949470:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684472192:0@lo:400:kworker.0 00000100:00080000:1.0:1783071326.949779:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071327.393852:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071328.418000:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783071328.921001:0:8904:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing yml_node 00010000:00010000:2.0:1783071329.465241:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071329.730024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071329.730063:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071329.730104:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071329.730132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071329.730158:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570048 00000100:00100000:0.0:1783071329.730168:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570048 00000100:00100000:0.0:1783071329.730219:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570176 00000100:00100000:0.0:1783071329.730223:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570176 00000100:00100000:0.0:1783071329.730246:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071329.730256:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665570048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071329.730328:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665570048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071329.730336:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071329.730353:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1783071329.730359:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665570176:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071329.730393:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665570176:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071329.730400:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1783071329.730418:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569920 00000100:00100000:0.0:1783071329.730421:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569920 00000100:00100000:0.0:1783071329.730450:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1783071329.730457:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665569920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071329.730482:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665569920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071329.730489:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00080000:0.0:1783071329.730507:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071329.730512:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071329.730514:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071329.730935:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665569792 00000100:00100000:3.0:1783071329.730941:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665569792 00000100:00100000:3.0:1783071329.730987:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:3.0:1783071329.730994:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665569792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071329.731028:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2355:x1869685665569792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071329.731035:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00010000:00010000:3.0:1783071330.464870:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071331.490665:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071331.553047:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071331.553067:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684472704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071331.553164:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071331.554002:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472704 00000100:00100000:2.0:1783071331.554013:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472704 00000100:00100000:2.0:1783071331.554145:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783071331.554157:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684472704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071331.554204:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071331.554276:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684472704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071331.554283:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783071331.554480:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c3b800 x1869685684472704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071331.554509:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684472704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783071331.554738:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071332.064887:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071332.064965:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071332.065052:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472832 00000100:00100000:0.0:1783071332.065059:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472832 00000100:00100000:0.0:1783071332.065131:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071332.065141:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684472832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071332.065180:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071332.066079:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684472832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 928us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.066090:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783071332.066117:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783071332.066168:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa36bb80 x1869685684472832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071332.066190:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071332.066208:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071332.066216:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684472960:0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.066397:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071332.067271:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684472960 00000100:00100000:0.0:1783071332.067280:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684472960 00000100:00100000:0.0:1783071332.067326:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783071332.067335:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071332.067402:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684472960:12345-0@lo:400:kworker.0 Request processed in 68us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.067408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783071332.070568:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684473088:0@lo:400:kworker.0 00000100:00100000:0.0:1783071332.070640:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071332.070778:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684473472:0@lo:400:kworker.0 00000100:00100000:1.0:1783071332.070808:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071332.070829:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071332.070834:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684473344:0@lo:400:kworker.0 00000100:00100000:1.0:1783071332.070858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.072243:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684472960:0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.072330:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473088 00000100:00100000:2.0:1783071332.072337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473088 00000100:00100000:2.0:1783071332.072390:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473472 00000100:00100000:2.0:1783071332.072393:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473472 00000100:00100000:2.0:1783071332.072420:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071332.072429:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.072498:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684473088:12345-0@lo:400:kworker.0 Request processed in 69us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.072527:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071332.072546:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783071332.072551:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684473472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.072584:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684473472:12345-0@lo:400:kworker.0 Request processed in 33us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.072590:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783071332.072609:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684473216:0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.072638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071332.072670:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473216 00000100:00100000:2.0:1783071332.072696:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473216 00000100:00100000:2.0:1783071332.072717:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071332.072723:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684473216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071332.072755:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684473216:12345-0@lo:400:kworker.0 Request processed in 33us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071332.072762:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071332.072786:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684473216:0@lo:400:kworker.0 00000100:00080000:2.0:1783071332.072820:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071332.079047:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684473088:0@lo:400:kworker.0 00000100:00100000:0.0:1783071332.081662:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473344 00000100:00100000:0.0:1783071332.081698:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473344 00000100:00100000:0.0:1783071332.081758:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783071332.081767:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684473344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071332.081853:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684473344:12345-0@lo:400:kworker.0 Request processed in 87us (10992us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071332.081861:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783071332.082823:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa369f80 x1869685684473344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071332.082841:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684473344:0@lo:400:kworker.0 00000100:00100000:1.0:1783071332.082857:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684473472:0@lo:400:kworker.0 00010000:00010000:2.0:1783071332.516723:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071332.708579:0:9095:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:1.0:1783071333.539827:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071334.560901:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071334.866007:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071334.866056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071334.866084:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071334.866151:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071334.866180:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570432 00000100:00100000:1.0:1783071334.866190:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570432 00000100:00100000:1.0:1783071334.866258:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071334.866269:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665570432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071334.866360:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665570432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071334.866368:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071334.866391:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570560 00000100:00100000:1.0:1783071334.866394:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570560 00000100:00100000:1.0:1783071334.866416:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570688 00000100:00100000:1.0:1783071334.866418:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570688 00000100:00100000:1.0:1783071334.866438:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1783071334.866444:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2354:x1869685665570560:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:1.0:1783071334.866469:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7155 00000100:00080000:1.0:1783071334.866479:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071334.867205:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783071334.867642:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+2:2354:x1869685665570560:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 1195us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071334.867651:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1783071334.867669:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1783071334.867693:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2354:x1869685665570688:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:1.0:1783071334.867714:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec715c 00000100:00080000:1.0:1783071334.867722:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782c2eca000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071334.867748:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783071334.867916:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+2:2354:x1869685665570688:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 239us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071334.867923:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00080000:1.0:1783071334.867957:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071334.867961:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071334.867964:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783071334.868737:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071334.868898:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570304 00000100:00100000:3.0:1783071334.868906:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570304 00010000:00010000:1.0:1783071334.869061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071334.875267:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:3.0:1783071334.875291:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2358:x1869685665570304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071334.875399:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2358:x1869685665570304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 119us (9402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071334.875407:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000001:02000400:3.0:1783071335.160007:0:9193:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:0.0:1783071335.584950:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071335.726857:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071335.726941:0:6612:0:(genops.c:906:class_export_put()) final put ffff9782c2ece000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071335.726976:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c2ece000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-OST0000 00000020:00000080:1.0:1783071335.727021:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c2ec9800 for lustre-OST0000 00010000:00010000:1.0:1783071336.609837:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071336.673052:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684473600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071336.673130:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071336.673266:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473600 00000100:00100000:3.0:1783071336.673280:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473600 00000100:00100000:3.0:1783071336.673345:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071336.673356:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684473600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071336.673392:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071336.673448:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684473600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071336.673455:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783071336.673590:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c5c3b800 x1869685684473600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071336.673609:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c5c3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684473600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783071336.673767:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071337.185426:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684473728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071337.185504:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071337.185651:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473728 00000100:00100000:1.0:1783071337.185660:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473728 00000100:00100000:1.0:1783071337.186185:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071337.186206:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684473728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071337.186254:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071337.186308:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684473728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071337.186316:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783071337.186338:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071337.187836:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684473984:0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.187892:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071337.187922:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071337.187927:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684473856:0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.187959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071337.187990:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684474112:0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.188013:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071337.188162:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071337.188168:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684474240:0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.188193:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071337.189857:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473984 00000100:00100000:0.0:1783071337.189871:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473984 00000100:00100000:0.0:1783071337.189931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474112 00000100:00100000:0.0:1783071337.189934:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474112 00000100:00100000:0.0:1783071337.189954:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474240 00000100:00100000:0.0:1783071337.189956:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474240 00000100:00100000:0.0:1783071337.189987:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071337.189995:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071337.190083:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684473984:12345-0@lo:400:kworker.0 Request processed in 88us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071337.190090:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071337.190106:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071337.190111:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684474112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071337.190140:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684474112:12345-0@lo:400:kworker.0 Request processed in 29us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071337.190145:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071337.190153:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071337.190159:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071337.190181:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684474240:12345-0@lo:400:kworker.0 Request processed in 22us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071337.190186:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1783071337.190209:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071337.190243:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684474240:0@lo:400:kworker.0 00000100:00100000:0.0:1783071337.190254:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684474112:0@lo:400:kworker.0 00000100:00100000:0.0:1783071337.190291:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684473984:0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.190747:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684473856 00000100:00100000:2.0:1783071337.190752:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684473856 00000100:00100000:2.0:1783071337.190786:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783071337.190793:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071337.190835:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684473856:12345-0@lo:400:kworker.0 Request processed in 43us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071337.190842:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:3.0:1783071337.190923:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa36aa00 x1869685684473728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071337.190941:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684473728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071337.190949:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684473856:0@lo:400:kworker.0 00000001:02000400:0.0:1783071337.202313:0:9291:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:0.0:1783071337.633200:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071338.261997:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:2.0:1783071338.262005:0:7495:0:(genops.c:906:class_export_put()) final put ffff9782c2ecc000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071338.262065:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c2ecc000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-OST0001 00000020:00000080:1.0:1783071338.262119:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c2eca000 for lustre-OST0001 00010000:00010000:1.0:1783071338.665110:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071338.765838:0:9340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 05:35:38 EDT 2026 00010000:00010000:0.0:1783071339.680923:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071339.971805:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071339.971900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071339.973118:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570944 00000100:00100000:2.0:1783071339.973131:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570944 00000100:00100000:2.0:1783071339.973212:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1783071339.973224:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665570944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071339.973305:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665570944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 83us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071339.973313:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00080000:2.0:1783071339.973335:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071339.974223:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665570816 00000100:00100000:0.0:1783071339.974230:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665570816 00000100:00100000:0.0:1783071339.974285:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:0.0:1783071339.974293:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2358:x1869685665570816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071339.974340:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2358:x1869685665570816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071339.974348:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00010000:00010000:2.0:1783071340.709863:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071341.730421:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071341.803383:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684474368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071341.803452:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071341.803638:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474368 00000100:00100000:3.0:1783071341.803645:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474368 00000100:00100000:3.0:1783071341.803721:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071341.803730:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684474368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071341.803766:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071341.803810:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684474368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071341.803817:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1783071341.803902:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782c3e24a80 x1869685684474368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071341.803920:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684474368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783071341.804474:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071342.305153:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684474624:0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305225:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071342.305292:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684475136:0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305317:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071342.305349:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071342.305355:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684474752:0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305377:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071342.305405:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475136 00000100:00100000:2.0:1783071342.305412:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475136 00000100:00100000:2.0:1783071342.305462:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071342.305471:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684475136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305519:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684475136:12345-0@lo:400:kworker.0 Request processed in 48us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071342.305526:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783071342.305549:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474624 00000100:00100000:2.0:1783071342.305552:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474624 00000100:00100000:2.0:1783071342.305575:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474752 00000100:00100000:2.0:1783071342.305579:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474752 00000100:00100000:2.0:1783071342.305598:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071342.305604:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684474624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305634:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684474624:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071342.305640:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783071342.305649:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071342.305655:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305703:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684474752:12345-0@lo:400:kworker.0 Request processed in 47us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071342.305721:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783071342.305737:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071342.305741:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071342.305777:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684474752:0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.305788:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684474624:0@lo:400:kworker.0 00010000:00080000:2.0:1783071342.305798:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa978380 x1869685684475136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071342.305808:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684475136:0@lo:400:kworker.0 00000100:00100000:3.0:1783071342.305978:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684474880:0@lo:400:kworker.0 00000100:00100000:3.0:1783071342.306018:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071342.306040:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783071342.306045:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684474496:0@lo:400:kworker.0 00000100:00100000:3.0:1783071342.306067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071342.306099:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684475008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071342.306120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071342.306145:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474496 00000100:00100000:3.0:1783071342.306149:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474496 00000100:00100000:3.0:1783071342.306176:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783071342.306182:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684474496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071342.306215:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684474496:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071342.306221:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783071342.306246:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475008 00000100:00100000:3.0:1783071342.306250:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475008 00000100:00100000:3.0:1783071342.306272:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783071342.306278:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684475008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071342.306305:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071342.306335:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684475008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071342.306341:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783071342.306371:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684474496:0@lo:400:kworker.0 00010000:00080000:3.0:1783071342.306381:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa369180 x1869685684475008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071342.306394:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684475008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071342.306536:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684474880 00000100:00100000:2.0:1783071342.306540:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684474880 00000100:00100000:2.0:1783071342.306585:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783071342.306591:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684474880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071342.306626:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684474880:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071342.306633:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1783071342.306737:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071342.306757:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684474880:0@lo:400:kworker.0 00010000:00010000:2.0:1783071342.752934:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071343.783012:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071344.804749:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071345.098025:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071345.098081:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071345.098588:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571200 00000100:00100000:0.0:1783071345.098600:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571200 00000100:00100000:0.0:1783071345.098883:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071345.098896:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665571200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071345.098993:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665571200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 101us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071345.099001:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071345.099034:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571072 00000100:00100000:0.0:1783071345.099039:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571072 00000100:00100000:0.0:1783071345.099064:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:0.0:1783071345.099071:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665571072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071345.099097:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665571072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071345.099103:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00080000:0.0:1783071345.101233:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071345.828630:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071346.852584:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071346.914359:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783071346.916108:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684475264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071346.916181:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071346.916858:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475264 00000100:00100000:2.0:1783071346.916868:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475264 00000100:00100000:2.0:1783071346.916934:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071346.916944:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684475264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071346.916994:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071346.917050:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684475264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071346.917070:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783071346.917115:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa978380 x1869685684475264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071346.917134:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684475264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783071346.920154:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071347.424898:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684475648:0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.424979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071347.425035:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071347.425042:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684475776:0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.425064:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071347.425096:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475648 00000100:00100000:2.0:1783071347.425114:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475648 00000100:00100000:2.0:1783071347.425162:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475776 00000100:00100000:2.0:1783071347.425165:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475776 00000100:00100000:2.0:1783071347.425185:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783071347.425192:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684475648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.425243:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684475648:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071347.425249:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783071347.425266:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783071347.425273:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684475776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.425299:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684475776:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071347.425305:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071347.425449:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684475392:0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071347.425509:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684475904:0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071347.425564:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071347.425570:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684475520:0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071347.425612:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071347.425624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475520 00000100:00100000:1.0:1783071347.425627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475520 00000100:00100000:1.0:1783071347.425666:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071347.425698:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425734:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684475520:12345-0@lo:400:kworker.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071347.425740:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071347.425759:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475392 00000100:00100000:1.0:1783071347.425762:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475392 00000100:00100000:1.0:1783071347.425784:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783071347.425791:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684475392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425817:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684475392:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071347.425823:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783071347.425848:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684475904 00000100:00100000:1.0:1783071347.425852:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684475904 00000100:00100000:1.0:1783071347.425882:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071347.425888:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684475904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425918:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684475904:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071347.425924:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783071347.425956:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071347.425983:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684475520:0@lo:400:kworker.0 00000100:00100000:1.0:1783071347.425992:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684475392:0@lo:400:kworker.0 00010000:00080000:1.0:1783071347.426004:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa978700 x1869685684475904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071347.426014:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684475904:0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.426251:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684475776:0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.426273:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684475648:0@lo:400:kworker.0 00000100:00100000:2.0:1783071347.428648:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071347.428738:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684476032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071347.428800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071347.428851:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476032 00000100:00100000:3.0:1783071347.428859:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476032 00000100:00100000:3.0:1783071347.428962:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783071347.428972:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684476032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071347.429009:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071347.429067:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684476032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071347.429073:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783071347.429141:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa368000 x1869685684476032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071347.429160:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684476032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783071347.877333:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071348.897598:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071349.921098:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071350.208468:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071350.208513:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071350.208692:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571456 00000100:00100000:0.0:1783071350.208702:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571456 00000100:00100000:0.0:1783071350.208765:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:0.0:1783071350.208775:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665571456:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071350.208848:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665571456:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071350.208856:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00080000:1.0:1783071350.209008:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071350.209418:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571328 00000100:00100000:3.0:1783071350.209424:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571328 00000100:00100000:3.0:1783071350.209499:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:3.0:1783071350.209506:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665571328:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071350.209548:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665571328:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 43us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071350.209554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00010000:00010000:1.0:1783071350.950369:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071351.973779:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071352.032926:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071352.032951:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684476160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071352.033023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071352.033212:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476160 00000100:00100000:2.0:1783071352.033230:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476160 00000100:00100000:2.0:1783071352.033286:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783071352.033295:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684476160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071352.033341:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071352.033387:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684476160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071352.033394:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783071352.033538:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97a680 x1869685684476160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071352.033552:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684476160:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783071352.033713:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071352.545247:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684476288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071352.545329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071352.545463:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476288 00000100:00100000:2.0:1783071352.545471:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476288 00000100:00100000:2.0:1783071352.545531:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071352.545542:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684476288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071352.545577:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071352.545624:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684476288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071352.545632:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1783071352.545712:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783071352.545755:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97aa00 x1869685684476288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071352.545773:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684476288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071352.546203:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684476416:0@lo:400:kworker.0 00000100:00100000:1.0:1783071352.546239:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071352.546387:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684476672:0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.546417:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071352.546440:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071352.546446:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684476800:0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.546478:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071352.546505:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476672 00000100:00100000:0.0:1783071352.546509:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476672 00000100:00100000:0.0:1783071352.546545:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476800 00000100:00100000:0.0:1783071352.546549:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476800 00000100:00100000:0.0:1783071352.546570:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071352.546576:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684476672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.546615:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684476672:12345-0@lo:400:kworker.0 Request processed in 39us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071352.546621:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071352.546636:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783071352.546642:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684476800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.546670:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684476800:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071352.546702:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783071352.546833:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071352.546840:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684476544:0@lo:400:kworker.0 00000100:00100000:1.0:1783071352.546864:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071352.547079:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476544 00000100:00100000:0.0:1783071352.547083:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476544 00000100:00100000:0.0:1783071352.547169:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783071352.547176:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684476544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.547297:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684476544:12345-0@lo:400:kworker.0 Request processed in 121us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071352.547303:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783071352.547329:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071352.547352:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684476800:0@lo:400:kworker.0 00000100:00100000:0.0:1783071352.547362:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684476672:0@lo:400:kworker.0 00000100:00100000:2.0:1783071352.547553:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476416 00000100:00100000:2.0:1783071352.547558:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476416 00000100:00100000:2.0:1783071352.547593:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783071352.547600:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684476416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071352.547635:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684476416:12345-0@lo:400:kworker.0 Request processed in 37us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071352.547650:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783071352.547882:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684476544:0@lo:400:kworker.0 00000100:00100000:1.0:1783071352.547891:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684476416:0@lo:400:kworker.0 00000001:02000400:2.0:1783071352.929812:0:9970:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:35:52 (1783071352) === 00010000:00010000:1.0:1783071352.995173:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071353.304730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.304885:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571584 00000100:00100000:3.0:1783071353.304895:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571584 00000100:00100000:3.0:1783071353.304971:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:3.0:1783071353.304980:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:8088:x1869685665571584:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071353.304997:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071353.305015:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef1000/0xd360fc6ce6ec7220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca844 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.305045:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef1000/0xd360fc6ce6ec7220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca844 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.305056:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef1000/0xd360fc6ce6ec7220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca844 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.305065:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1000, rc 0) 00000100:00100000:3.0:1783071353.305125:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665571584:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 145us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.305132:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:0.0:1783071353.316147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.316242:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571712 00000100:00100000:3.0:1783071353.316252:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571712 00000100:00100000:3.0:1783071353.316327:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:3.0:1783071353.316338:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665571712:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071353.316665:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665571712:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 328us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.316709:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:0.0:1783071353.323661:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.323885:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571840 00000100:00100000:3.0:1783071353.323904:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571840 00000100:00100000:3.0:1783071353.323968:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:3.0:1783071353.323978:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665571840:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783071353.324211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665571840:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 234us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.324221:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:1.0:1783071353.330633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.331441:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665571968 00000100:00100000:3.0:1783071353.331452:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665571968 00000100:00100000:3.0:1783071353.331507:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:3.0:1783071353.331516:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8092:x1869685665571968:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071353.333536:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8092:x1869685665571968:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 2005us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.333550:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:1.0:1783071353.374020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.374117:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572096 00000100:00100000:3.0:1783071353.374126:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572096 00000100:00100000:3.0:1783071353.374178:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:3.0:1783071353.374191:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8092:x1869685665572096:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071353.374449:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8092:x1869685665572096:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 263us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.374458:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:0.0:1783071353.378479:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.378664:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572224 00000100:00100000:3.0:1783071353.378725:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572224 00000100:00100000:3.0:1783071353.378784:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:3.0:1783071353.378794:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:8088:x1869685665572224:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071353.378811:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071353.378828:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef0a00/0xd360fc6ce6ec7227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca86e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.378854:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef0a00/0xd360fc6ce6ec7227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca86e expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.378866:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef0a00/0xd360fc6ce6ec7227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca86e expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071353.378874:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0a00, rc 0) 00000100:00100000:3.0:1783071353.378951:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:8088:x1869685665572224:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 158us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.378958:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:1.0:1783071353.382769:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.382847:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572352 00000100:00100000:3.0:1783071353.382857:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572352 00000100:00100000:3.0:1783071353.382920:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:3.0:1783071353.382930:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:8088:x1869685665572352:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783071353.382954:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783071353.382977:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783071353.382981:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783071353.382984:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783071353.382987:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783071353.386875:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:8088:x1869685665572352:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 3938us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.386905:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:1.0:1783071353.389845:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071353.389935:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572480 00000100:00100000:2.0:1783071353.389944:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572480 00000100:00100000:2.0:1783071353.389993:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:2.0:1783071353.390002:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:8088:x1869685665572480:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071353.390019:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071353.390034:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca875 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.390059:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.390067:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071353.390075:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071353.390136:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8088:x1869685665572480:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.390143:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:1.0:1783071353.392120:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.392219:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572608 00000100:00100000:3.0:1783071353.392226:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572608 00000100:00100000:3.0:1783071353.392331:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:3.0:1783071353.392341:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8088:x1869685665572608:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071353.392864:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8088:x1869685665572608:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 520us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.392873:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:1.0:1783071353.394751:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071353.394805:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572736 00000100:00100000:2.0:1783071353.394813:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572736 00000100:00100000:2.0:1783071353.394855:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:2.0:1783071353.394863:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8088:x1869685665572736:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783071353.395048:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8088:x1869685665572736:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 185us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.395066:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:1.0:1783071353.397015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.397053:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572864 00000100:00100000:3.0:1783071353.397061:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572864 00000100:00100000:3.0:1783071353.397103:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:3.0:1783071353.397112:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8098:x1869685665572864:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071353.397671:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8098:x1869685665572864:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 556us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.397713:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:1.0:1783071353.399730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071353.399785:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665572992 00000100:00100000:2.0:1783071353.399794:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665572992 00000100:00100000:2.0:1783071353.399843:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:2.0:1783071353.399852:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8098:x1869685665572992:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071353.400096:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:8098:x1869685665572992:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 235us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.400104:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:1.0:1783071353.406556:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071353.406737:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573120 00000100:00100000:0.0:1783071353.406747:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573120 00000100:00100000:0.0:1783071353.406825:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1783071353.406832:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1869685665573120:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783071353.406859:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b05f6892-fe62-4bbe-88b4-45795cda05e5@192.168.202.16@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1783071353.406893:0:5791:0:(genops.c:1406:class_connect()) connect: client b05f6892-fe62-4bbe-88b4-45795cda05e5, cookie 0xd360fc6ce6ec7235 00000004:00100000:0.0:1783071353.406933:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783071353.407171:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071353.407455:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2354:x1869685665573120:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 620us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.407462:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1783071353.407979:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071353.408599:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573504 00000100:00100000:1.0:1783071353.408608:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573504 00000100:00080000:2.0:1783071353.408705:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071353.408881:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1783071353.409156:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665573504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071353.409370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665573504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 478us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.409377:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1783071353.411619:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071353.411714:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573376 00000100:00100000:0.0:1783071353.411723:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573376 00000100:00100000:0.0:1783071353.411808:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071353.411818:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665573376:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783071353.411860:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1783071353.411881:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071353.411948:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665573376:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.411956:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071353.412874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071353.412957:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573248 00000100:00100000:2.0:1783071353.412963:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573248 00000100:00100000:2.0:1783071353.413004:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1783071353.413012:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:0:x1869685665573248:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783071353.413033:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783071353.413085:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:0:x1869685665573248:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.413101:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1783071353.416836:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.416925:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573632 00000100:00100000:3.0:1783071353.416934:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573632 00000100:00100000:3.0:1783071353.416985:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1783071353.416993:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665573632:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783071353.417071:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665573632:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071353.417083:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1783071353.420279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071353.420337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071353.420356:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574016 00000100:00100000:1.0:1783071353.420366:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574016 00000100:00100000:3.0:1783071353.420368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071353.420417:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1783071353.420428:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665574016:12345-192.168.202.16@tcp:33:mount.lustre.0 00000100:00100000:2.0:1783071353.420578:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573760 00000100:00100000:2.0:1783071353.420582:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573760 00000100:00100000:2.0:1783071353.420611:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665573888 00000100:00100000:2.0:1783071353.420614:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665573888 00000100:00100000:2.0:1783071353.420633:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1783071353.420638:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869685665573760:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783071353.420659:0:8704:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b05f6892-fe62-4bbe-88b4-45795cda05e5@192.168.202.16@tcp t0 exp 0000000000000000 cur 254 last 0 00000100:00100000:0.0:1783071353.420704:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1783071353.420710:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869685665573888:12345-192.168.202.16@tcp:8:mount.lustre.0 00000020:00000080:2.0:1783071353.420718:0:8704:0:(genops.c:1406:class_connect()) connect: client b05f6892-fe62-4bbe-88b4-45795cda05e5, cookie 0xd360fc6ce6ec723c 00010000:00080000:0.0:1783071353.420725:0:6585:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b05f6892-fe62-4bbe-88b4-45795cda05e5@192.168.202.16@tcp t0 exp 0000000000000000 cur 254 last 0 00002000:00100000:2.0:1783071353.420730:0:8704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b05f6892-fe62-4bbe-88b4-45795cda05e5/ffff9781c5c51800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:0.0:1783071353.420739:0:6585:0:(genops.c:1406:class_connect()) connect: client b05f6892-fe62-4bbe-88b4-45795cda05e5, cookie 0xd360fc6ce6ec7243 00002000:00100000:2.0:1783071353.420741:0:8704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1783071353.420743:0:6585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b05f6892-fe62-4bbe-88b4-45795cda05e5/ffff9782f9ba6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071353.420749:0:6585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783071353.420937:0:8704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1783071353.420937:0:6585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783071353.420963:0:8704:0:(import.c:65:import_set_state_nolock()) ffff9781c5c52800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783071353.420963:0:6585:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071353.421103:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2354:x1869685665573760:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 463us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071353.421111:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000004:00200000:1.0:1783071353.421350:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783071353.422409:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2354:x1869685665573888:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 1690us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071353.422421:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1783071353.423519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:8088:x1869685665574016:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 3088us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071353.423531:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000001:00100000:0.0:1783071353.605012:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00010000:00010000:2.0:1783071354.016888:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783071354.111167:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00010000:00010000:2.0:1783071355.041927:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071356.066762:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071356.188028:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00010000:00010000:2.0:1783071357.088926:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071357.153077:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684476928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071357.153178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071357.153394:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684476928 00000100:00100000:3.0:1783071357.153402:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684476928 00000100:00100000:3.0:1783071357.153488:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783071357.153500:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684476928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071357.153541:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783071357.153610:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071357.155140:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684476928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1634us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071357.155152:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783071357.158994:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97b800 x1869685684476928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071357.159023:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684476928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071357.665847:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684477184:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.665857:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684477312:0@lo:400:kworker.0 00000100:00100000:1.0:1783071357.667203:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684477056:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.671581:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071357.671644:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477312 00000100:00100000:2.0:1783071357.671655:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477312 00000100:00100000:2.0:1783071357.671736:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071357.671747:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684477312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.671811:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684477312:12345-0@lo:400:kworker.0 Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071357.671826:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1783071357.671851:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071357.671914:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684477312:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.671926:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684477824:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.671957:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071357.672024:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477824 00000100:00100000:2.0:1783071357.672028:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477824 00000100:00100000:2.0:1783071357.672055:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783071357.672062:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.672097:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684477824:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071357.672104:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1783071357.672119:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783071357.672134:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782faa12a00 x1869685684477824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071357.672145:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684477824:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.672172:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684477568:0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.672196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071357.672229:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477568 00000100:00100000:2.0:1783071357.672233:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477568 00000100:00100000:2.0:1783071357.672253:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071357.672259:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684477568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.672290:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684477568:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071357.672296:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783071357.672327:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782faa11180 x1869685684477568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071357.672337:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684477568:0@lo:400:kworker.0 00000100:00100000:3.0:1783071357.674211:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071357.674735:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684477696:0@lo:400:kworker.0 00000100:00100000:3.0:1783071357.674776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071357.674809:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477184 00000100:00100000:3.0:1783071357.674815:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477184 00000100:00100000:3.0:1783071357.674851:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477696 00000100:00100000:3.0:1783071357.674853:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477696 00000100:00100000:3.0:1783071357.674891:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783071357.674898:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684477184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071357.674942:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684477184:12345-0@lo:400:kworker.0 Request processed in 44us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071357.674949:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783071357.674961:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071357.674967:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071357.674986:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684477696:12345-0@lo:400:kworker.0 Request processed in 19us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071357.674997:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071357.675027:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684477696:0@lo:400:kworker.0 00000100:00100000:3.0:1783071357.675049:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684477184:0@lo:400:kworker.0 00000100:00080000:2.0:1783071357.676081:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071357.676203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071357.676844:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684477440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071357.676904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071357.677014:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477056 00000100:00100000:2.0:1783071357.677021:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477056 00000100:00100000:2.0:1783071357.677778:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783071357.677791:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684477056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071357.677858:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684477056:12345-0@lo:400:kworker.0 Request processed in 71us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071357.677874:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783071357.678178:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684477056:0@lo:400:kworker.0 00000100:00100000:0.0:1783071357.678235:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477440 00000100:00100000:0.0:1783071357.678242:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477440 00000100:00100000:0.0:1783071357.678277:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071357.678298:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684477440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071357.678332:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071357.678398:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684477440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071357.678404:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1783071357.679496:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97b480 x1869685684477440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071357.679524:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684477440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783071358.112846:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071358.450929:0:10166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1783071358.920315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071358.920362:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071358.920397:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071358.920433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071358.920489:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574144 00000100:00100000:2.0:1783071358.920499:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574144 00000100:00100000:2.0:1783071358.920549:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:2.0:1783071358.920558:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665574144:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071358.920634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665574144:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071358.920642:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:3.0:1783071358.921132:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071358.921196:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574656 00000100:00100000:2.0:1783071358.921200:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574656 00000100:00100000:2.0:1783071358.921236:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574528 00000100:00100000:2.0:1783071358.921239:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574528 00000100:00100000:2.0:1783071358.921258:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071358.921264:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071358.921304:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071358.921327:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071358.921339:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1783071358.921345:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071358.921372:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071358.921377:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:2.0:1783071358.921393:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071358.921397:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071358.930363:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574400 00000100:00100000:0.0:1783071358.930389:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574400 00000100:00100000:0.0:1783071358.930483:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574272 00000100:00100000:0.0:1783071358.930487:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574272 00000100:00100000:0.0:1783071358.930517:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1783071358.930526:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071358.930818:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1783071358.930829:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665574272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071358.930903:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665574272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 75us (10469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071358.930910:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00080000:2.0:1783071358.931944:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071358.932454:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665574400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1921us (12084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071358.932465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00010000:00010000:2.0:1783071359.136829:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071360.164795:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071361.184881:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071362.208977:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071362.273010:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071362.273033:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684477952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071362.273110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.273238:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684477952 00000100:00100000:2.0:1783071362.273247:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684477952 00000100:00100000:2.0:1783071362.273315:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071362.273324:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684477952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071362.273365:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071362.273417:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684477952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071362.273424:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1783071362.273493:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071362.273557:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97aa00 x1869685684477952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.273575:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684477952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071362.786971:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684478080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071362.787040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071362.787135:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478080 00000100:00100000:2.0:1783071362.787143:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478080 00000100:00100000:2.0:1783071362.787198:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783071362.787207:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684478080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071362.787245:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071362.787293:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684478080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071362.787300:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783071362.787360:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783071362.787400:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97a680 x1869685684478080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.787418:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684478080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071362.787940:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684478336:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.787976:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.787999:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783071362.788004:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684478208:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788029:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.788050:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684478720:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788069:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.788096:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478336 00000100:00100000:1.0:1783071362.788100:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478336 00000100:00100000:1.0:1783071362.788132:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478720 00000100:00100000:1.0:1783071362.788135:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478720 00000100:00100000:1.0:1783071362.788158:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783071362.788165:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684478336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788205:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684478336:12345-0@lo:400:kworker.0 Request processed in 40us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.788211:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783071362.788223:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783071362.788229:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684478720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788254:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684478720:12345-0@lo:400:kworker.0 Request processed in 26us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.788260:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783071362.788275:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478208 00000100:00100000:1.0:1783071362.788278:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478208 00000100:00100000:1.0:1783071362.788312:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783071362.788318:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684478208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788347:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684478208:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.788353:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1783071362.788385:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071362.788405:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684478208:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788415:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684478720:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788423:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684478336:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788441:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684478592:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.788484:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071362.788490:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684478464:0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071362.788530:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478592 00000100:00100000:1.0:1783071362.788533:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478592 00000100:00100000:1.0:1783071362.788558:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071362.788565:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684478592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.788598:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684478592:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.788603:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071362.788620:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478464 00000100:00100000:1.0:1783071362.788623:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478464 00000100:00100000:1.0:1783071362.788647:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783071362.788652:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684478464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071362.789037:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684478464:12345-0@lo:400:kworker.0 Request processed in 383us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071362.789044:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1783071362.789060:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071362.789077:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684478464:0@lo:400:kworker.0 00010000:00080000:1.0:1783071362.789087:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bf7800 x1869685684478592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071362.789096:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684478592:0@lo:400:kworker.0 00010000:00010000:1.0:1783071363.235654:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071364.031863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071364.031903:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071364.031939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071364.031962:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071364.031986:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071364.032026:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574784 00000100:00100000:0.0:1783071364.032036:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574784 00000100:00100000:0.0:1783071364.032082:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:0.0:1783071364.032091:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665574784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071364.032172:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665574784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.032180:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:0.0:1783071364.032228:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665574912 00000100:00100000:0.0:1783071364.032232:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665574912 00000100:00100000:0.0:1783071364.032276:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575040 00000100:00100000:0.0:1783071364.032280:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575040 00000100:00100000:0.0:1783071364.032299:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1783071364.032305:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665574912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071364.032337:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665574912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.032343:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1783071364.032354:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1783071364.032360:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071364.032380:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.032386:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1783071364.032403:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575168 00000100:00100000:0.0:1783071364.032407:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575168 00000100:00100000:0.0:1783071364.032433:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575296 00000100:00100000:0.0:1783071364.032436:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575296 00000100:00100000:0.0:1783071364.032456:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1783071364.032462:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575168:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071364.032486:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575168:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.032492:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1783071364.032502:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1783071364.032508:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575296:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071364.032530:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665575296:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071364.032545:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00080000:0.0:1783071364.032722:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071364.032726:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071364.032729:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783071364.262827:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071365.280843:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071366.304978:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071367.330083:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071367.401514:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071367.401663:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684478848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071367.401817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071367.401939:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478848 00000100:00100000:2.0:1783071367.401947:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478848 00000100:00100000:2.0:1783071367.402008:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071367.402018:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684478848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071367.402054:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071367.402101:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684478848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071367.402109:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783071367.402178:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071367.402207:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa978700 x1869685684478848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071367.402226:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684478848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071367.905794:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684478976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071367.905915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071367.906236:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684478976 00000100:00100000:1.0:1783071367.906243:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684478976 00000100:00100000:1.0:1783071367.906293:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783071367.906303:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684478976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071367.906335:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071367.906375:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684478976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071367.906382:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1783071367.906420:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bf7800 x1869685684478976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071367.906437:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684478976:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783071367.909381:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071367.909404:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684479232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.909467:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071367.909504:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071367.909511:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684479360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.909535:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071367.909566:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479232 00000100:00100000:0.0:1783071367.909572:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479232 00000100:00100000:0.0:1783071367.909624:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479360 00000100:00100000:0.0:1783071367.909628:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479360 00000100:00100000:0.0:1783071367.909656:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783071367.909664:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684479232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.909738:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684479232:12345-0@lo:400:kworker.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.909752:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783071367.909769:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783071367.910048:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684479360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910081:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684479360:12345-0@lo:400:kworker.0 Request processed in 305us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.910088:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1783071367.910114:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071367.910143:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684479360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910228:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684479232:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910255:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684479488:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071367.910315:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071367.910321:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684479104:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071367.910372:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684479616:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910392:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071367.910412:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479488 00000100:00100000:0.0:1783071367.910416:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479488 00000100:00100000:0.0:1783071367.910442:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071367.910449:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684479488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910482:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684479488:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.910488:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071367.910506:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479104 00000100:00100000:0.0:1783071367.910516:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479104 00000100:00100000:0.0:1783071367.910541:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783071367.910547:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.910576:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684479104:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.910581:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783071367.912042:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479616 00000100:00100000:0.0:1783071367.912055:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479616 00000100:00100000:0.0:1783071367.912119:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783071367.912129:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684479616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.912268:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684479616:12345-0@lo:400:kworker.0 Request processed in 140us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071367.912275:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783071367.912323:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684479104:0@lo:400:kworker.0 00000100:00100000:0.0:1783071367.912336:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684479616:0@lo:400:kworker.0 00010000:00080000:0.0:1783071367.912350:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9ed0000 x1869685684479488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071367.912361:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684479488:0@lo:400:kworker.0 00000100:00080000:2.0:1783071367.912441:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783071368.354956:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071369.154110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071369.154220:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071369.154380:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575552 00000100:00100000:1.0:1783071369.154391:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575552 00000100:00100000:1.0:1783071369.154501:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1783071369.154527:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665575552:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071369.154605:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665575552:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071369.154613:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1783071369.154739:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575424 00000100:00100000:0.0:1783071369.154752:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575424 00000100:00100000:0.0:1783071369.154832:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:0.0:1783071369.154843:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665575424:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071369.154941:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665575424:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 98us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071369.154962:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00080000:2.0:1783071369.156074:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071369.159735:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071369.159925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071369.159952:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071369.159994:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575808 00000100:00100000:0.0:1783071369.160006:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575808 00000100:00100000:0.0:1783071369.160081:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575936 00000100:00100000:0.0:1783071369.160085:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575936 00000100:00100000:0.0:1783071369.160110:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071369.160121:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071369.160219:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 99us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071369.160228:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071369.160249:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1783071369.160256:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071369.160284:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071369.160290:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1783071369.160312:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665575680 00000100:00100000:0.0:1783071369.160315:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665575680 00000100:00100000:0.0:1783071369.160349:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1783071369.160356:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071369.160389:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665575680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071369.160395:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00080000:2.0:1783071369.160511:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071369.160517:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071369.160520:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783071369.377877:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071370.400947:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071371.426776:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071372.451056:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071372.513078:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071372.513145:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071372.515841:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479744 00000100:00100000:1.0:1783071372.515857:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479744 00000100:00100000:1.0:1783071372.515932:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783071372.515943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684479744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071372.515985:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783071372.516117:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071372.516588:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684479744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 646us (3440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071372.516610:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783071372.518333:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa978380 x1869685684479744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071372.518355:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071373.024990:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684479872:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025069:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071373.025307:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071373.025315:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684480256:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071373.025391:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684480000:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025416:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071373.025437:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071373.025444:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684480128:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025469:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071373.025491:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684479872 00000100:00100000:1.0:1783071373.025500:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684479872 00000100:00100000:0.0:1783071373.025503:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480256 00000100:00100000:0.0:1783071373.025509:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480256 00000100:00100000:0.0:1783071373.025549:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071373.025552:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783071373.025561:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684480256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071373.025566:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684479872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025625:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684480256:12345-0@lo:400:kworker.0 Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071373.025630:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684479872:12345-0@lo:400:kworker.0 Request processed in 67us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.025637:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071373.025642:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783071373.025689:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480000 00000100:00100000:0.0:1783071373.025693:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480000 00000100:00100000:0.0:1783071373.025720:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480128 00000100:00100000:0.0:1783071373.025724:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480128 00000100:00100000:0.0:1783071373.025769:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783071373.025774:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025803:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684480000:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.025816:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1783071373.025821:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071373.025830:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071373.025837:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684480128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025860:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684480128:12345-0@lo:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071373.025866:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783071373.025908:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684480128:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025921:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684480000:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.025947:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684480384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071373.025974:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783071373.026004:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782faa13100 x1869685684480256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071373.026016:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684480256:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.026028:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684479872:0@lo:400:kworker.0 00000100:00100000:1.0:1783071373.026037:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480384 00000100:00100000:1.0:1783071373.026043:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480384 00000100:00100000:1.0:1783071373.026085:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783071373.026091:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684480384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071373.026120:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071373.026212:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684480384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071373.026219:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783071373.026284:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bf7800 x1869685684480384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071373.026298:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684480384:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783071373.026355:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071373.026567:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684480512:0@lo:400:kworker.0 00000100:00100000:0.0:1783071373.026596:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071373.027033:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480512 00000100:00100000:2.0:1783071373.027039:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480512 00000100:00100000:2.0:1783071373.027093:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783071373.027101:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684480512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071373.027660:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684480512:12345-0@lo:400:kworker.0 Request processed in 557us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071373.027667:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783071373.027750:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684480512:0@lo:400:kworker.0 00000100:00080000:0.0:1783071373.027768:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783071373.051292:0:10867:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783071373.472965:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071374.278578:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071374.278638:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071374.278667:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071374.278717:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071374.278755:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071374.278786:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576320 00000100:00100000:0.0:1783071374.278796:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576320 00000100:00100000:0.0:1783071374.278845:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576192 00000100:00100000:0.0:1783071374.278849:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576192 00000100:00100000:0.0:1783071374.278874:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1783071374.278883:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665576320:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071374.278975:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665576320:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.278983:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1783071374.279000:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1783071374.279006:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665576192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071374.279032:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665576192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.279038:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1783071374.279056:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576448 00000100:00100000:0.0:1783071374.279059:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576448 00000100:00100000:0.0:1783071374.279081:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576576 00000100:00100000:0.0:1783071374.279083:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576576 00000100:00100000:0.0:1783071374.279116:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071374.279123:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2354:x1869685665576448:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1783071374.279143:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec723c 00000100:00080000:0.0:1783071374.279152:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9781c5c52800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783071374.279191:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783071374.279689:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576064 00000100:00100000:2.0:1783071374.279694:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576064 00000100:00100000:2.0:1783071374.279726:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:2.0:1783071374.279748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665576064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071374.279781:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665576064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071374.279798:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:0.0:1783071374.280420:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+2:2354:x1869685665576448:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 1295us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.280429:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071374.280446:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071374.280453:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2354:x1869685665576576:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1783071374.280470:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7243 00000100:00080000:0.0:1783071374.280477:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783071374.280575:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783071374.280817:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+2:2354:x1869685665576576:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 364us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071374.280824:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:0.0:1783071374.280846:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071374.280850:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071374.280852:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071374.282060:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071374.282154:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071374.501084:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.523839:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783071375.698927:0:11014:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6771dcb0 20000000:00000080:0.0:1783071375.698944:0:11014:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9782fa850400 uarg=0000000000000000 20000000:01000000:0.0:1783071375.698980:0:11014:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783071375.698986:0:11014:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783071375.698990:0:11014:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783071375.700076:0:11015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1783071375.700227:0:11014:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783071375.705261:0:11014:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783071375.705294:0:11014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705314:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705321:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705342:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705352:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705359:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705367:0:11014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705482:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705497:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.705512:0:11014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480640:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071375.705749:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705757:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.705766:0:11014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480768:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071375.705801:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705820:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.705828:0:11014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480896:0@lo:104: 00000100:00100000:0.0:1783071375.705870:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071375.705959:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.705967:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 18 pid: 5784 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.705975:0:11014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684481024:0@lo:104: 00000100:00100000:0.0:1783071375.705998:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071375.707050:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.707061:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 18 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.707072:0:11014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684481152:0@lo:104: 00000100:00100000:0.0:1783071375.707103:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071375.707122:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684480896 00000100:00100000:2.0:1783071375.707129:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684480896 00000100:00100000:3.0:1783071375.707183:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481024 00000100:00100000:3.0:1783071375.707187:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481024 00000100:00100000:3.0:1783071375.707225:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071375.707235:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:11014:x1869685684480896:12345-0@lo:104: 00010000:00010000:3.0:1783071375.707247:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071375.707302:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071375.707308:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:11014:x1869685684480896:12345-0@lo:104: Request processed in 75us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.707315:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071375.707332:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783071375.707338:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11014:x1869685684481024:12345-0@lo:104: 00010000:00010000:3.0:1783071375.707345:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071375.707372:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071375.707377:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11014:x1869685684481024:12345-0@lo:104: Request processed in 40us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071375.707382:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1783071375.707510:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071375.707517:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707524:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938e00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071375.707529:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707537:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071375.707545:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071375.707551:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071375.707586:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707592:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071375.707613:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707620:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938e00/0xd360fc6ce6ec71fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7204 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707644:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071375.707647:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707652:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071375.707655:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707662:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071375.707668:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071375.707695:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071375.707710:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707716:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071375.707783:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707790:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938000/0xd360fc6ce6ec71d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71da expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.707799:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.707801:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.707803:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.707809:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071375.707827:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684481280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071375.707859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071375.707894:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684481408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071375.707929:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071375.707959:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481280 00000100:00100000:1.0:1783071375.707964:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481280 00010000:00010000:1.0:1783071375.707984:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 19 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071375.708004:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481408 00000100:00100000:1.0:1783071375.708007:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481408 00010000:00010000:1.0:1783071375.708018:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 20 pid: 5784 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071375.708030:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071375.708036:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3295:x1869685684481280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071375.708046:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071375.708050:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 20 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.708060:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 20 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.708073:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071375.708099:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3295:x1869685684481280:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071375.708106:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071375.708142:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071375.708149:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684481408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071375.708162:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071375.708167:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 19 pid: 5784 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.708176:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 19 pid: 5784 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.708185:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071375.708211:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684481408:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071375.708217:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783071375.708251:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684481408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071375.708274:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684481280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071375.711004:0:11014:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c29459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071375.711049:0:11014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480640:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071375.711060:0:11014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480768:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071375.711071:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef0c00/0xd360fc6ce6ec7204 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec71fd expref: 18 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.711088:0:11014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684480896:0@lo:104: 00010000:00010000:0.0:1783071375.711119:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef1200/0xd360fc6ce6ec71da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec71d3 expref: 17 pid: 5784 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.711128:0:11014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684481024:0@lo:104: 00000100:00100000:1.0:1783071375.711269:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481152 00000100:00100000:1.0:1783071375.711277:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481152 00000100:00100000:1.0:1783071375.711330:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071375.711339:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11014:x1869685684481152:12345-0@lo:104: 00010000:00010000:1.0:1783071375.711354:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712366:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071375.712377:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11014:x1869685684481152:12345-0@lo:104: Request processed in 1038us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071375.712386:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783071375.712502:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071375.712509:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712531:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071375.712535:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712546:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071375.712553:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071375.712559:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071375.712597:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712603:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071375.712622:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712629:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0800/0xd360fc6ce6ec71a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec71b0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.712644:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.712646:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071375.712648:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071375.712662:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684481536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071375.712737:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071375.712786:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481536 00000100:00100000:1.0:1783071375.712792:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481536 00010000:00010000:1.0:1783071375.712816:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 17 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071375.712850:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783071375.712857:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:3293:x1869685684481536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071375.712871:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071375.712877:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 17 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.713329:0:11014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1869685684481152:0@lo:104: 00010000:00010000:0.0:1783071375.713364:0:11014:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.713467:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 17 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.713489:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d7000/0xd360fc6ce6ec71b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec71a9 expref: 17 pid: 5783 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071375.713502:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071375.713537:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3293:x1869685684481536:12345-0@lo:103:ldlm_bl.0 Request processed in 681us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071375.713544:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783071375.713575:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684481536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071375.713964:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071375.714003:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576704 00000100:00100000:0.0:1783071375.714008:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576704 00010000:00010000:0.0:1783071375.714029:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.714064:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071375.714071:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665576704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071375.714081:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071375.714088:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714109:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714121:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec722e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca875 expref: 13 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714129:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071375.714167:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:2358:x1869685665576704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071375.714174:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1783071375.714399:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071375.714631:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576832 00000100:00100000:0.0:1783071375.714636:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576832 00010000:00010000:0.0:1783071375.714654:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071375.714689:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1783071375.714697:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:2358:x1869685665576832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071375.714705:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071375.714710:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714730:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714741:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030a00/0xd360fc6ce6ec7219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca83d expref: 12 pid: 5784 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714752:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714760:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714774:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714780:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714786:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714802:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714808:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071375.714813:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714820:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714832:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714841:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071375.714862:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:2358:x1869685665576832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 166us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071375.714868:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00010000:00010000:0.0:1783071375.714892:0:11014:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714899:0:11014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071375.714905:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec724a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071376.545100:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071376.641269:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00000020:00000080:1.0:1783071376.641278:0:6612:0:(genops.c:906:class_export_put()) final put ffff9781c5c51800/b05f6892-fe62-4bbe-88b4-45795cda05e5 00000020:00000080:3.0:1783071376.641442:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c5c51800/b05f6892-fe62-4bbe-88b4-45795cda05e5 for lustre-OST0000 00000020:00000080:3.0:1783071376.641556:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c5c52800 for lustre-OST0000 00010000:00010000:1.0:1783071377.572775:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783071377.573984:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071377.573990:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0f800 from 7 10000000:01000000:1.0:1783071377.573995:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071377.574038:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071377.574049:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071377.574069:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071377.574095:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071377.574167:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.574212:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.574280:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481664 00000100:00100000:2.0:1783071377.574288:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481664 00000100:00100000:2.0:1783071377.574343:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783071377.574352:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684481664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071377.574367:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071377.574380:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec7251 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.574401:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.574412:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.574421:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938400, rc 0) 00000100:00100000:2.0:1783071377.574460:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684481664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.574468:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783071377.574556:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071377.574569:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071377.574578:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071377.574626:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071377.574651:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.574714:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.574763:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481792 00000100:00100000:2.0:1783071377.574767:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481792 00000100:00100000:2.0:1783071377.574799:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783071377.574806:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684481792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.575048:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684481792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.575054:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783071377.575080:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.575105:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.575138:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.575156:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.575166:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684481920 00000100:00100000:2.0:1783071377.575169:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684481920 00000100:00100000:2.0:1783071377.575186:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783071377.575192:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684481920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.575320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684481920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.575326:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783071377.575359:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684481920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783071377.576020:0:11115:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783071377.576073:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783071377.576089:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071377.576099:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576109:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071377.576118:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071377.576120:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782f9bac800 from 7 10000000:01000000:2.0:1783071377.576132:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071377.576158:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576166:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576174:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071377.576189:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.576224:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.576242:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.576257:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482048 00000100:00100000:2.0:1783071377.576261:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482048 00000100:00100000:2.0:1783071377.576289:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783071377.576296:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684482048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071377.576307:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071377.576318:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec725f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576338:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576347:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576355:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939000, rc 0) 00000100:00100000:2.0:1783071377.576385:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.576400:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783071377.576435:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071377.576446:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.576454:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071377.576493:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.576516:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.576529:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.576539:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482176 00000100:00100000:2.0:1783071377.576543:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482176 00000100:00100000:2.0:1783071377.576562:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783071377.576568:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.581106:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4529us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.581120:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783071377.582610:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa978700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071377.583139:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071377.583195:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071377.583251:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.583318:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482304 00000100:00100000:2.0:1783071377.583324:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482304 00000100:00100000:2.0:1783071377.583393:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783071377.583401:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.583584:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.583591:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783071377.583655:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071377.589112:0:11116:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783071377.589206:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783071377.589230:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071377.589241:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589253:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071377.589264:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071377.589266:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c8344000 from 7 10000000:01000000:2.0:1783071377.589269:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071377.589309:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589318:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589328:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071377.589351:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.589415:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.589452:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.589470:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482432 00000100:00100000:2.0:1783071377.589476:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482432 00000100:00100000:2.0:1783071377.589517:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783071377.589525:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684482432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071377.589538:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071377.589550:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec726d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589583:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589594:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589603:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:2.0:1783071377.589638:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684482432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.589645:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783071377.589723:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071377.589737:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071377.589745:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071377.589788:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.589811:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.589824:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071377.591869:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482560 00000100:00100000:2.0:1783071377.591883:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482560 00000100:00100000:2.0:1783071377.591936:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783071377.591946:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684482560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.592243:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684482560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.592260:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783071377.592310:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.592357:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.592398:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.592424:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071377.592436:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482688 00000100:00100000:3.0:1783071377.592440:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482688 00000100:00100000:3.0:1783071377.592470:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783071377.592477:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684482688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071377.592628:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684482688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071377.592636:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783071377.592727:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684482688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783071377.593963:0:11117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783071377.594596:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783071377.594617:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071377.594628:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.594646:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071377.633032:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071377.633097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071377.633196:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482816 00000100:00100000:2.0:1783071377.633203:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482816 00000100:00100000:2.0:1783071377.633269:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071377.633281:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684482816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071377.633318:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071377.633364:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684482816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.633369:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783071377.633402:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa97a680 x1869685684482816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071377.633427:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684482816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783071377.633470:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071377.663936:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071377.664103:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665576960 00000100:00100000:3.0:1783071377.664114:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665576960 00000100:00100000:3.0:1783071377.664180:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:3.0:1783071377.664190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:5569:x1869685665576960:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071377.664205:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071377.664222:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca89f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.664250:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.664262:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.664270:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071377.664320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665576960:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 132us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071377.664327:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:2.0:1783071377.676601:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071377.677016:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577088 00000100:00100000:3.0:1783071377.677028:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577088 00000100:00100000:2.0:1783071377.677239:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:2.0:1783071377.677253:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665577088:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.678258:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665577088:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 1004us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.678280:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:0.0:1783071377.683446:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071377.683536:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577216 00000100:00100000:2.0:1783071377.683547:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577216 00000100:00100000:2.0:1783071377.683603:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:2.0:1783071377.683614:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665577216:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.683855:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665577216:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 241us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.683863:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:0.0:1783071377.697240:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071377.697739:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577344 00000100:00100000:3.0:1783071377.697760:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577344 00000100:00100000:3.0:1783071377.697817:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:3.0:1783071377.697827:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665577344:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071377.697846:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071377.697864:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8a6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.697905:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.697917:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071377.697926:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071377.697986:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665577344:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 160us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071377.697993:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:0.0:1783071377.699766:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071377.699853:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577472 00000100:00100000:3.0:1783071377.699862:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577472 00000100:00100000:3.0:1783071377.699910:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:3.0:1783071377.699918:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665577472:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071377.700192:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665577472:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 272us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071377.700199:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:0.0:1783071377.702046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071377.702135:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577600 00000100:00100000:2.0:1783071377.702144:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577600 00000100:00100000:2.0:1783071377.702193:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:2.0:1783071377.702212:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665577600:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071377.702428:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665577600:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 217us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071377.702436:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:0.0:1783071378.144828:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684482944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071378.144915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071378.145008:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684482944 00000100:00100000:0.0:1783071378.145016:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684482944 00000100:00100000:0.0:1783071378.145381:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071378.145393:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684482944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071378.145430:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071378.145476:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684482944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.145483:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783071378.145505:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783071378.145534:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa784e00 x1869685684482944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071378.145552:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684482944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071378.151808:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684483200:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.151880:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071378.151930:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071378.151936:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684483072:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.151966:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071378.152005:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483200 00000100:00100000:0.0:1783071378.152012:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483200 00000100:00100000:0.0:1783071378.152057:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783071378.152066:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684483200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152242:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869685684483200:12345-0@lo:400:kworker.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.152260:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783071378.152285:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483072 00000100:00100000:0.0:1783071378.152289:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483072 00000100:00100000:0.0:1783071378.152311:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783071378.152317:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684483072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152346:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684483072:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.152352:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783071378.152385:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684483328:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152408:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071378.152430:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071378.152435:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684483456:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071378.152477:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483328 00000100:00100000:0.0:1783071378.152481:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483328 00000100:00100000:0.0:1783071378.152506:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483456 00000100:00100000:0.0:1783071378.152509:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483456 00000100:00100000:0.0:1783071378.152526:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783071378.152532:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684483328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152565:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684483328:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.152571:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783071378.152582:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783071378.152588:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684483456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152615:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684483456:12345-0@lo:400:kworker.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071378.152630:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783071378.152650:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071378.152714:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684483456:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152727:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684483328:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152756:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684483072:0@lo:400:kworker.0 00000100:00100000:0.0:1783071378.152766:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869685684483200:0@lo:400:kworker.0 00010000:00010000:0.0:1783071378.595856:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783071379.234294:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00000020:00000080:1.0:1783071379.234303:0:7495:0:(genops.c:906:class_export_put()) final put ffff9782f9ba6800/b05f6892-fe62-4bbe-88b4-45795cda05e5 00000020:00000080:3.0:1783071379.234377:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ba6800/b05f6892-fe62-4bbe-88b4-45795cda05e5 for lustre-OST0001 00000020:00000080:3.0:1783071379.234425:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782f9ba6000 for lustre-OST0001 00000100:00100000:0.0:1783071379.392249:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071379.392338:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071379.392375:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071379.392413:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577728 00000100:00100000:2.0:1783071379.392423:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577728 00000100:00100000:2.0:1783071379.392479:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:2.0:1783071379.392489:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665577728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071379.392555:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665577728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071379.392563:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:3.0:1783071379.402725:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577856 00000100:00100000:3.0:1783071379.402747:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577856 00000100:00100000:3.0:1783071379.402817:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665577984 00000100:00100000:3.0:1783071379.402820:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665577984 00000100:00100000:3.0:1783071379.402849:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1783071379.402859:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665577856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071379.402946:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665577856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 88us (10706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071379.402954:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1783071379.402972:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:3.0:1783071379.402980:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665577984:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071379.403005:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665577984:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (10630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071379.403024:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00080000:0.0:1783071379.405302:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1783071379.453954:0:11214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783071379.625386:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071380.642510:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071381.664898:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783071382.608169:0:11314:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:36:21 (1783071381) === 00010000:00010000:2.0:1783071382.689428:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071382.753554:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684483584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071382.753642:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071382.753849:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483584 00000100:00100000:0.0:1783071382.753928:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483584 00000100:00100000:0.0:1783071382.753999:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071382.754010:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684483584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071382.754046:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783071382.754285:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071382.754414:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684483584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 406us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071382.754422:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1783071382.757548:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bf7100 x1869685684483584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071382.757579:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684483584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071382.830960:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071382.831014:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071382.831276:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665578240 00000100:00100000:2.0:1783071382.831297:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665578240 00000100:00100000:2.0:1783071382.831365:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1783071382.831377:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9642:x1869685665578240:12345-192.168.202.16@tcp:700:mkdir.0 00000100:00100000:2.0:1783071382.831476:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9642:x1869685665578240:12345-192.168.202.16@tcp:700:mkdir.0 Request processed in 101us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071382.831485:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1783071382.832025:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665578112 00000100:00100000:0.0:1783071382.832031:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665578112 00000100:00100000:0.0:1783071382.832083:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071382.832091:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665578112:12345-192.168.202.16@tcp:41:mkdir.0 00000004:00000024:0.0:1783071382.832124:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783071382.832186:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2355:x1869685665578112:12345-192.168.202.16@tcp:41:mkdir.0 Request processed in 95us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071382.832193:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00080000:1.0:1783071382.832841:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071382.839424:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071382.839585:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665578496 00000100:00100000:0.0:1783071382.839596:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665578496 00000100:00100000:0.0:1783071382.839853:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071382.839864:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9642:x1869685665578496:12345-192.168.202.16@tcp:36:mkdir.0 00010000:00010000:0.0:1783071382.839926:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071382.839998:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030200/0xd360fc6ce6ec716a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca828 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840017:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071382.840027:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071382.840376:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840391:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840401:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840413:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840419:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.840426:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071382.844152:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783071382.844171:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844182:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844189:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844195:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071382.844199:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844273:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844294:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:1.0:1783071382.844298:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071382.844309:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.844316:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7289 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071382.844337:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001829c517 reply state 000000000db97a1c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071382.844347:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071382.844550:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9642:x1869685665578496:12345-192.168.202.16@tcp:36:mkdir.0 Request processed in 4683us (5130us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783071382.844559:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00010000:00010000:3.0:1783071382.846503:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846520:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846527:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846533:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071382.846537:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846557:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846571:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9782cc2b6b00) 00010000:00010000:3.0:1783071382.846575:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071382.846578:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071382.846585:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7290 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071382.858850:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071382.859233:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665578624 00000100:00100000:0.0:1783071382.859244:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665578624 00000100:00100000:0.0:1783071382.859340:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1783071382.859351:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9643:x1869685665578624:12345-192.168.202.16@tcp:101:chmod.0 00010000:00010000:0.0:1783071382.859373:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071382.859394:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec7297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8ad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859467:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859590:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859604:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071382.859783:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783071382.859788:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071382.859845:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859943:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec7297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ad expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859964:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ad expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.859972:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071382.859989:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071382.859993:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9600, rc 0) 00000100:00100000:0.0:1783071382.860062:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9643:x1869685665578624:12345-192.168.202.16@tcp:101:chmod.0 Request processed in 713us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071382.860138:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1783071382.862593:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071382.862993:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665578880 00000100:00100000:0.0:1783071382.863003:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665578880 00000100:00100000:0.0:1783071382.863157:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1783071382.863168:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9643:x1869685665578880:12345-192.168.202.16@tcp:36:chmod.0 00010000:00010000:0.0:1783071382.863234:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071382.863260:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec729e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ad expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.863281:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071382.863292:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071382.863314:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.863327:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.863335:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071382.863816:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2ae49c3 reply state 0000000093efc1c1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071382.863837:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783071382.863860:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783071382.863949:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:9643:x1869685665578880:12345-192.168.202.16@tcp:36:chmod.0 Request processed in 782us (1363us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783071382.863963:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00010000:00010000:2.0:1783071382.866020:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866035:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866043:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866050:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071382.866054:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866062:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866153:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6a00) 00010000:00010000:2.0:1783071382.866156:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071382.866160:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071382.866167:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071382.923047:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071382.923173:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665579008 00000100:00100000:1.0:1783071382.923183:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665579008 00000100:00100000:1.0:1783071382.923271:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1783071382.923281:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9644:x1869685665579008:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:1.0:1783071382.923305:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071382.923329:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8b4 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923397:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923411:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923423:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071382.923506:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783071382.923509:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071382.923548:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923573:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8b4 expref: 9 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923594:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8b4 expref: 8 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.923601:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62ca00) 00010000:00010000:1.0:1783071382.923604:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071382.923607:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7000, rc 0) 00000100:00100000:1.0:1783071382.923736:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:9644:x1869685665579008:12345-192.168.202.16@tcp:101:chown.0 Request processed in 456us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071382.923744:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1783071382.930435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071382.930580:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665579136 00000100:00100000:0.0:1783071382.930590:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665579136 00000100:00100000:0.0:1783071382.930640:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1783071382.930647:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:9644:x1869685665579136:12345-192.168.202.16@tcp:101:chown.0 00010000:00010000:0.0:1783071382.930808:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071382.930829:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8bb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.930906:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.930919:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.930931:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.930945:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.930952:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931132:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931361:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931388:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931395:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071382.931437:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783071382.931441:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071382.931808:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931822:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931829:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931835:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931841:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071382.931845:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931909:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931925:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62ca00) 00010000:00010000:0.0:1783071382.931928:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071382.931933:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.931951:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932032:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932039:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932044:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932049:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071382.932052:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932058:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932129:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071382.932133:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071382.932136:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932143:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932183:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8bb expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932196:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8bb expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.932222:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6900) 00010000:00010000:0.0:1783071382.932224:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071382.932227:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9a00, rc 0) 00000100:00100000:0.0:1783071382.932631:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:9644:x1869685665579136:12345-192.168.202.16@tcp:101:chown.0 Request processed in 1982us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071382.932637:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1783071382.938161:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071382.938348:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665579392 00000100:00100000:1.0:1783071382.938359:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665579392 00000100:00100000:1.0:1783071382.938528:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1783071382.938538:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:9644:x1869685665579392:12345-192.168.202.16@tcp:36:chown.0 00010000:00010000:1.0:1783071382.938588:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071382.938610:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec72cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8bb expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.938626:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6900) 00010000:00010000:1.0:1783071382.938648:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071382.938707:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.938716:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071382.938722:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071382.969145:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1783071382.969162:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1783071382.969333:0:6976:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062df347b reply state 00000000ee77c3db transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071382.969344:0:6976:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783071382.969483:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783071382.969576:0:6976:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783071382.969593:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9644:x1869685665579392:12345-192.168.202.16@tcp:36:chown.0 Request processed in 31054us (31437us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783071382.969599:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00010000:00010000:0.0:1783071382.969668:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969704:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969710:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969714:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071382.969717:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969722:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969735:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:0.0:1783071382.969737:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783071382.969740:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071382.969753:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec72d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071382.995053:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071382.996656:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665579520 00000100:00100000:0.0:1783071382.996762:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665579520 00000100:00100000:2.0:1783071382.997408:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1783071382.997423:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9645:x1869685665579520:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:2.0:1783071382.997452:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071382.997474:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec72dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8c2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071382.998314:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 788us 00010000:00010000:0.0:1783071383.023421:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.023443:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.023456:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.023472:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.023478:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.023484:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024080:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024090:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024097:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071383.024190:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783071383.024195:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071383.024300:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024313:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024320:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024327:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024333:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071383.024338:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024345:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024358:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62ca00) 00010000:00010000:0.0:1783071383.024361:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071383.024365:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024372:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec72e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024385:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024401:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024406:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024411:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071383.024414:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024421:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024429:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071383.024432:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071383.024435:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024440:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec72eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024480:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec72dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c2 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024496:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c2 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.024504:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:0.0:1783071383.024506:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783071383.024514:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8e00, rc 0) 00000100:00100000:0.0:1783071383.024592:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9645:x1869685665579520:12345-192.168.202.16@tcp:101:touch.500 Request processed in 27172us (29547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.024603:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1783071383.028283:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071383.028366:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665579776 00000100:00100000:3.0:1783071383.028376:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665579776 00000100:00100000:3.0:1783071383.028434:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1783071383.028444:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9645:x1869685665579776:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:3.0:1783071383.028463:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071383.028483:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1c00/0xd360fc6ce6ec72f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8c9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029023:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029040:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029051:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029104:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029120:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.029127:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071383.030010:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1783071383.030281:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec730e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030294:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec730e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030303:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec730e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030339:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030347:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030354:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030361:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071383.030365:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030372:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030397:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:3.0:1783071383.030400:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071383.030405:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030411:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1800/0xd360fc6ce6ec7300 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071383.030424:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007319b0d3 reply state 00000000be526aec transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071383.030433:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071383.030467:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1c00/0xd360fc6ce6ec72f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c9 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030482:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec730e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c9 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071383.030489:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071383.030491:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071383.030493:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1600, rc 0) 00000100:00100000:3.0:1783071383.030580:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:9645:x1869685665579776:12345-192.168.202.16@tcp:101:touch.500 Request processed in 2137us (2306us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783071383.030590:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1783071383.039304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071383.039355:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580032 00000100:00100000:1.0:1783071383.039370:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580032 00010000:00010000:0.0:1783071383.039405:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039418:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039426:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039433:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071383.039438:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039445:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039463:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd20cd46 (ffff9782d9936400) 00010000:00010000:0.0:1783071383.039466:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071383.039470:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.039476:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7307 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071383.039540:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1783071383.039551:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:9645:x1869685665580032:12345-192.168.202.16@tcp:36:touch.500 00010000:00010000:1.0:1783071383.039609:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071383.039628:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec730e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c9 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.039639:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071383.039645:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071383.039736:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.039750:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.039758:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071383.040174:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeb58e51 reply state 00000000e24813bb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071383.040218:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071383.040326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:9645:x1869685665580032:12345-192.168.202.16@tcp:36:touch.500 Request processed in 776us (1029us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783071383.040333:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00010000:00010000:2.0:1783071383.042627:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042646:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042654:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042706:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.042726:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042734:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042751:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782cd62c300) 00010000:00010000:2.0:1783071383.042755:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.042760:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.042779:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec731c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071383.046372:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.046917:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580160 00000100:00100000:0.0:1783071383.046929:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580160 00000100:00100000:0.0:1783071383.047001:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1783071383.047012:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:9645:x1869685665580160:12345-192.168.202.16@tcp:101:touch.500 00010000:00010000:0.0:1783071383.047037:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071383.047070:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec7323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8d0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.047130:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec7323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d0 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.047145:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec7323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d0 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.047164:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071383.047167:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071383.047170:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9600, rc 0) 00000100:00100000:0.0:1783071383.047231:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:9645:x1869685665580160:12345-192.168.202.16@tcp:101:touch.500 Request processed in 220us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.047239:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1783071383.053510:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.053716:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580288 00000100:00100000:0.0:1783071383.053727:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580288 00000100:00100000:0.0:1783071383.053784:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1783071383.053803:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869685665580288:12345-192.168.202.16@tcp:8:touch.500 00010000:00080000:0.0:1783071383.053835:0:8704:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1783071383.053868:0:8704:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec732a 00002000:00100000:0.0:1783071383.053881:0:8704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a/ffff9782c67f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071383.053906:0:8704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071383.054135:0:8704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783071383.054179:0:8704:0:(import.c:65:import_set_state_nolock()) ffff9782fa848000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071383.054253:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665580288:12345-192.168.202.16@tcp:8:touch.500 Request processed in 458us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.054261:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1783071383.059934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.060036:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580416 00000100:00100000:0.0:1783071383.060050:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580416 00000100:00100000:0.0:1783071383.060133:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1783071383.060145:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:0:x1869685665580416:12345-192.168.202.16@tcp:2:touch.500 00000100:00080000:1.0:1783071383.060453:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783071383.104638:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1783071383.104655:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000100:00100000:1.0:1783071383.105049:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:0:x1869685665580416:12345-192.168.202.16@tcp:2:touch.500 Request processed in 44901us (45120us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783071383.105061:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1783071383.108421:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.108638:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580672 00000100:00100000:0.0:1783071383.108648:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580672 00000100:00100000:0.0:1783071383.108750:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1783071383.108760:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:9645:x1869685665580672:12345-192.168.202.16@tcp:35:touch.500 00000100:00100000:0.0:1783071383.109467:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:9645:x1869685665580672:12345-192.168.202.16@tcp:35:touch.500 Request processed in 705us (1052us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783071383.109475:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1783071383.132605:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071383.132934:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665580800 00000100:00100000:2.0:1783071383.132946:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665580800 00000100:00100000:2.0:1783071383.133011:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1783071383.133022:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:9646:x1869685665580800:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1783071383.133049:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071383.133135:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8d7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133343:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133357:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133368:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071383.133531:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783071383.133549:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071383.133594:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133623:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d7 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133642:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d7 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.133651:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:2.0:1783071383.133655:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071383.133669:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:2.0:1783071383.134044:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:9646:x1869685665580800:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1022us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071383.134052:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:1.0:1783071383.141485:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.141601:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581056 00000100:00100000:0.0:1783071383.141612:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581056 00000100:00100000:2.0:1783071383.141793:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1783071383.141806:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:9646:x1869685665581056:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1783071383.141900:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071383.141926:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec733f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8de expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071383.142050:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783071383.142619:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec733f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8de expref: 14 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.142636:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62ca00) 00010000:00010000:2.0:1783071383.142639:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071383.142652:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec733f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8de expref: 14 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.142789:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:2.0:1783071383.143159:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:9646:x1869685665581056:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1355us (1682us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783071383.143168:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:3.0:1783071383.151326:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.151424:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581184 00000100:00100000:0.0:1783071383.151434:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581184 00000100:00100000:0.0:1783071383.151483:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1783071383.151491:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:9646:x1869685665581184:12345-192.168.202.16@tcp:37:rm.0 00000100:00100000:0.0:1783071383.159645:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:9646:x1869685665581184:12345-192.168.202.16@tcp:37:rm.0 Request processed in 8137us (8430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.159706:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1783071383.169000:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071383.169421:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581440 00000100:00100000:3.0:1783071383.169433:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581440 00000100:00100000:3.0:1783071383.169543:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1783071383.169555:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d69d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:9646:x1869685665581440:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:3.0:1783071383.169910:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d69d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:9646:x1869685665581440:12345-192.168.202.16@tcp:35:rm.0 Request processed in 355us (1121us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783071383.169919:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1783071383.173561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071383.174020:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581696 00000100:00100000:1.0:1783071383.174033:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581696 00000100:00100000:1.0:1783071383.174230:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1783071383.174242:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:9646:x1869685665581696:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:1.0:1783071383.174268:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071383.174289:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec734d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8e5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.174428:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec7354 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.174443:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec7354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.174455:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec7354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071383.174480:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783071383.174641:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec734d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8e5 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.174736:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec7354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8e5 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.174745:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:1.0:1783071383.174747:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783071383.174751:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d6400, rc 0) 00000100:00100000:1.0:1783071383.174818:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665581696:12345-192.168.202.16@tcp:101:rm.0 Request processed in 579us (1268us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783071383.174833:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1783071383.178811:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071383.179457:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581824 00000100:00100000:0.0:1783071383.179467:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581824 00000100:00100000:0.0:1783071383.179566:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071383.179576:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665581824:12345-192.168.202.16@tcp:41:rm.0 00000004:00000024:0.0:1783071383.179635:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1783071383.179759:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665581824:12345-192.168.202.16@tcp:41:rm.0 Request processed in 185us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.179767:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071383.182416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071383.182475:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665581952 00000100:00100000:2.0:1783071383.182485:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665581952 00000100:00100000:2.0:1783071383.182590:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1783071383.182600:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665581952:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1783071383.182622:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071383.182644:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7362 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8ec expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182763:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182778:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182935:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182957:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182965:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.182996:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183189:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183199:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183290:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071383.183321:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783071383.183325:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071383.183342:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183351:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183357:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183361:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183365:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183369:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.183371:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183382:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183392:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:2.0:1783071383.183394:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.183397:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183401:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183411:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183414:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183418:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183421:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.183422:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183426:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183429:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd20cd46 (ffff9782d9b38400) 00010000:00010000:2.0:1783071383.183430:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.183432:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183441:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183466:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7362 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ec expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183474:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ec expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.183479:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:2.0:1783071383.183480:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071383.183482:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938000, rc 0) 00000100:00100000:2.0:1783071383.183539:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:9646:x1869685665581952:12345-192.168.202.16@tcp:101:rm.0 Request processed in 940us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071383.183546:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1783071383.188780:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071383.189234:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665582208 00000100:00100000:2.0:1783071383.189245:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665582208 00000100:00100000:2.0:1783071383.189298:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1783071383.189308:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:9646:x1869685665582208:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1783071383.189363:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783071383.189504:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8ec expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189525:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec7323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d0 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189537:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782cc2b6200) 00010000:00010000:2.0:1783071383.189564:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8d7 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189572:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:2.0:1783071383.189575:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071383.189592:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189603:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189611:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189623:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189630:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189637:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189978:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189988:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.189995:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071383.192186:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783071383.192213:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284566538217ns, next at 285566535424ns, rc = 0 00010000:00010000:2.0:1783071383.192287:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192301:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192310:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192318:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192323:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192328:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192353:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071383.192499:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192507:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192513:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192519:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.192522:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192539:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192551:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071383.192554:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783071383.192558:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192563:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec738c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192582:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192587:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192592:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192596:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.192598:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192603:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192610:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:2.0:1783071383.192612:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.192614:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.192628:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec737e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071383.192638:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f41307b7 reply state 000000007a085279 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071383.192647:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783071383.193190:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071383.193214:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.193221:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071383.193225:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.193232:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.193242:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:1.0:1783071383.193244:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071383.193247:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.193266:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec7393 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071383.193282:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071383.193284:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071383.193286:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071383.193494:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665582208:12345-192.168.202.16@tcp:36:rm.0 Request processed in 4183us (4729us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783071383.193503:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1783071383.198845:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071383.198987:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665582464 00000100:00100000:1.0:1783071383.198998:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665582464 00000100:00100000:1.0:1783071383.199052:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071383.199073:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665582464:12345-192.168.202.16@tcp:35:rm.0 00000100:00100000:1.0:1783071383.199351:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:9646:x1869685665582464:12345-192.168.202.16@tcp:35:rm.0 Request processed in 289us (515us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783071383.199360:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071383.202432:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071383.202529:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665582720 00000100:00100000:2.0:1783071383.202539:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665582720 00000100:00100000:2.0:1783071383.202595:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1783071383.202606:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:9646:x1869685665582720:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1783071383.202701:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783071383.202729:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6400/0xd360fc6ce6ec7354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8e5 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202752:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8e00/0xd360fc6ce6ec72f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8c2 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202775:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:2.0:1783071383.202801:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec72b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8b4 expref: 15 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202811:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62ca00) 00010000:00010000:2.0:1783071383.202833:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071383.202869:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202881:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202891:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202903:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202910:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.202917:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203261:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203270:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203277:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071383.203950:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783071383.203966:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203973:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203985:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.203991:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.203996:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204004:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204016:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9782d9b38b00) 00010000:00010000:2.0:1783071383.204019:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783071383.204022:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204028:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec73a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204052:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204057:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204061:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204066:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.204069:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204082:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204090:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d9b38400) 00010000:00010000:2.0:1783071383.204092:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.204095:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.204100:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec739a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071383.204112:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006dac20bc reply state 0000000053853751 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071383.204121:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071383.204204:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:9646:x1869685665582720:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1597us (1779us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783071383.204212:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00010000:00010000:0.0:1783071383.205539:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205553:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205561:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205566:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071383.205570:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205577:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205591:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd20cd46 (ffff9782d9b38700) 00010000:00010000:0.0:1783071383.205594:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071383.205598:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071383.205619:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7385 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd20cd46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207898:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207913:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207921:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207927:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217ce00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071383.207931:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207956:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207970:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9782d9b38900) 00010000:00010000:2.0:1783071383.207974:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071383.207978:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071383.207985:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec73a1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071383.264967:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071383.265046:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071383.265130:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684484224:0@lo:400:kworker.0 00000100:00100000:1.0:1783071383.265158:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071383.265181:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071383.265187:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684484096:0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265197:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684483840:0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071383.265254:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071383.265259:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684483968:0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071383.265310:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483712 00000100:00100000:0.0:1783071383.265316:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483712 00000100:00100000:0.0:1783071383.265368:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071383.265393:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684483712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071383.265402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783071383.265418:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071383.265429:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484224 00000100:00100000:1.0:1783071383.265432:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484224 00000100:00100000:1.0:1783071383.265461:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483968 00000100:00100000:0.0:1783071383.265461:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071383.265464:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483968 00000100:00100000:0.0:1783071383.265468:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783071383.265476:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484096 00000100:00100000:1.0:1783071383.265479:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484096 00000100:00100000:0.0:1783071383.265492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684483840 00000100:00100000:0.0:1783071383.265494:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684483840 00000100:00100000:1.0:1783071383.265509:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783071383.265514:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783071383.265515:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265518:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684483840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071383.265545:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684484224:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071383.265546:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684483840:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071383.265552:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783071383.265552:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783071383.265564:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783071383.265569:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684483968:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783071383.265575:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071383.265578:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071383.265594:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684483968:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071383.265599:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783071383.265608:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684483968:0@lo:400:kworker.0 00000100:00100000:1.0:1783071383.265609:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783071383.265615:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265624:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684483840:0@lo:400:kworker.0 00000100:00100000:1.0:1783071383.265637:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684484096:12345-0@lo:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071383.265642:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783071383.265654:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684484096:0@lo:400:kworker.0 00000100:00100000:0.0:1783071383.265718:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684484224:0@lo:400:kworker.0 00010000:00080000:0.0:1783071383.265730:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa787b80 x1869685684483712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071383.265744:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684483712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783071383.714484:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071384.512782:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071384.512831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071384.512861:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071384.512919:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071384.512959:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665582976 00000100:00100000:2.0:1783071384.512959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583232 00000100:00100000:3.0:1783071384.512971:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665582976 00000100:00100000:2.0:1783071384.512971:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583232 00000100:00100000:2.0:1783071384.513208:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:3.0:1783071384.513541:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1783071384.513552:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2356:x1869685665582976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071384.513639:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2356:x1869685665582976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 89us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071384.513663:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1783071384.514750:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665582848 00000100:00100000:3.0:1783071384.514760:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665582848 00000100:00100000:3.0:1783071384.514806:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:3.0:1783071384.514814:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665582848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071384.514890:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665582848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071384.514898:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:0.0:1783071384.515824:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583104 00000100:00100000:0.0:1783071384.515832:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583104 00000100:00100000:0.0:1783071384.515889:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1783071384.515898:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665583104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071384.515955:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665583104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 58us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071384.515962:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00080000:0.0:1783071384.515982:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071384.517804:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665583232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071384.517890:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665583232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 4673us (5058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071384.517901:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00010000:00010000:1.0:1783071384.743962:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071385.760900:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071386.787066:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783071386.923612:0:11466:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783071387.809195:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071387.873367:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684484352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071387.873466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071387.874602:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484352 00000100:00100000:1.0:1783071387.874612:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484352 00000100:00100000:1.0:1783071387.874732:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1783071387.874794:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071387.874875:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684484352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071387.874926:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1783071387.875185:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d5b800 x1869685684484352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071387.875205:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684484352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071387.875254:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684484352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.878193:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00000080:0.0:1783071387.942005:0:11514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde07f8330 20000000:00000080:0.0:1783071387.942023:0:11514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9782c5c9b000 uarg=0000000000000000 20000000:01000000:0.0:1783071387.942060:0:11514:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783071387.942073:0:11514:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783071387.942078:0:11514:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783071387.946788:0:11515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783071387.947384:0:11514:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1783071387.954898:0:11514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1783071387.954957:0:11514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1783071387.955008:0:11514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1783071387.955024:0:11514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783071387.955043:0:11514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955072:0:11514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955081:0:11514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955088:0:11514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955097:0:11514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955104:0:11514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955112:0:11514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955153:0:11514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955180:0:11514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 12 pid: 5785 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071387.955195:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484480:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071387.955301:0:11514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955310:0:11514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071387.955320:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484608:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071387.955350:0:11514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955358:0:11514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 18 pid: 5785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071387.955367:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa786300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484736:0@lo:104: 00000100:00100000:0.0:1783071387.955406:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071387.955433:0:11514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955441:0:11514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 18 pid: 5783 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071387.955449:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484864:0@lo:104: 00000100:00100000:0.0:1783071387.955470:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.955524:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484736 00000100:00100000:0.0:1783071387.955532:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484736 00000100:00100000:0.0:1783071387.955576:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484864 00000100:00100000:0.0:1783071387.955579:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484864 00000100:00100000:0.0:1783071387.955596:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071387.955604:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:11514:x1869685684484736:12345-0@lo:104: 00010000:00010000:0.0:1783071387.955616:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955669:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071387.955705:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+4:11514:x1869685684484736:12345-0@lo:104: Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.955712:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071387.955731:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783071387.955737:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11514:x1869685684484864:12345-0@lo:104: 00010000:00010000:0.0:1783071387.955745:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955772:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783071387.955777:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11514:x1869685684484864:12345-0@lo:104: Request processed in 41us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.955783:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1783071387.955820:0:11514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955828:0:11514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 18 pid: 5784 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071387.955836:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484992:0@lo:104: 00000100:00100000:0.0:1783071387.955863:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071387.955885:0:7482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783071387.955895:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684484992 00000100:00100000:0.0:1783071387.955898:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684484992 00000100:00100000:0.0:1783071387.955917:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071387.955923:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9b33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11514:x1869685684484992:12345-0@lo:104: 00010000:00010000:0.0:1783071387.955930:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.955954:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783071387.955958:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9b33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+3:11514:x1869685684484992:12345-0@lo:104: Request processed in 36us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071387.955963:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783071387.956002:0:11514:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af4000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071387.956021:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa786300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484736:0@lo:104: 00000100:00100000:0.0:1783071387.956030:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484864:0@lo:104: 00000100:00100000:0.0:1783071387.956036:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484992:0@lo:104: 00010000:00010000:2.0:1783071387.957112:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783071387.957122:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957140:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071387.957144:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957153:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071387.957160:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071387.957166:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071387.957198:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957203:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071387.957229:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957236:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939600/0xd360fc6ce6ec726d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7274 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957248:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071387.957252:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957257:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071387.957260:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957275:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071387.957280:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071387.957284:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071387.957295:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957299:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071387.957311:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957318:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec725f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7266 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957325:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071387.957328:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957333:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7c00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071387.957335:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957341:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071387.957346:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071387.957358:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071387.957370:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957375:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071387.957381:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957387:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d7c00/0xd360fc6ce6ec7251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec7258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957399:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071387.957401:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071387.957402:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071387.957407:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071387.957413:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071387.957424:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684485120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071387.957464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.957511:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684485248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071387.957534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.957550:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071387.957556:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684485376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071387.957577:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071387.957606:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485120 00000100:00100000:2.0:1783071387.957611:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485120 00010000:00010000:2.0:1783071387.957648:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 19 pid: 5785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071387.957702:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485248 00000100:00100000:2.0:1783071387.957706:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485248 00010000:00010000:2.0:1783071387.957719:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 20 pid: 5783 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071387.957729:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485376 00000100:00100000:2.0:1783071387.957731:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485376 00010000:00010000:2.0:1783071387.957740:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 21 pid: 5784 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071387.957751:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071387.957757:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+21:3294:x1869685684485120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071387.957769:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071387.957774:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 21 pid: 5785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957783:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 21 pid: 5785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957796:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939c00/0xd360fc6ce6ec7274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec726d expref: 21 pid: 5785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.957808:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071387.958421:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+20:3294:x1869685684485120:12345-0@lo:103:ldlm_bl.0 Request processed in 661us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.958428:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783071387.958446:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071387.958453:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684485248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071387.958469:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071387.958475:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 19 pid: 5783 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958543:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 19 pid: 5783 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958554:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939000/0xd360fc6ce6ec7266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec725f expref: 19 pid: 5783 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958563:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071387.958661:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684485120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071387.958738:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:3292:x1869685684485248:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.958745:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783071387.958758:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071387.958765:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:3292:x1869685684485376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071387.958772:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071387.958776:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 17 pid: 5784 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958783:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 17 pid: 5784 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958793:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec7258 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec7251 expref: 17 pid: 5784 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071387.958802:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071387.958834:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3292:x1869685684485376:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071387.958848:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783071387.960959:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684485248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071387.960992:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684485376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071387.961454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071387.962803:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583360 00000100:00100000:1.0:1783071387.962825:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583360 00010000:00010000:1.0:1783071387.962884:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 13 pid: 5785 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071387.962922:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071387.962931:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665583360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071387.962946:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071387.962953:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 13 pid: 5785 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.962964:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 13 pid: 5785 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.962984:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071387.963047:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665583360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 116us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.963054:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00010000:00010000:2.0:1783071387.963954:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef0200/0xd360fc6ce6ec7282 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8a6 expref: 12 pid: 5785 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071387.963968:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484480:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071387.965022:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071387.965098:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11514:1869685684484608:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071387.965136:0:11514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071387.965204:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583488 00000100:00100000:1.0:1783071387.965212:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583488 00010000:00010000:1.0:1783071387.965250:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071387.965287:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1783071387.965297:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:2358:x1869685665583488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071387.965315:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071387.965319:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965330:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965364:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef1e00/0xd360fc6ce6ec727b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca89f expref: 12 pid: 5783 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965381:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965389:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965405:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965412:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965419:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965425:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965432:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071387.965436:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965444:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965460:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071387.965492:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071387.965551:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:2358:x1869685665583488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 256us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071387.965558:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00010000:00010000:0.0:1783071387.966112:0:11514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.966121:0:11514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071387.966126:0:11514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec73af lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071388.385530:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684485504:0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.385613:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071388.385722:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071388.385731:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684485632:0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.385761:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071388.385857:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684485888:0@lo:400:kworker.0 00000100:00100000:2.0:1783071388.385888:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071388.385909:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071388.385914:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684485760:0@lo:400:kworker.0 00000100:00100000:2.0:1783071388.385931:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071388.385966:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485888 00000100:00100000:2.0:1783071388.385972:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485888 00000100:00100000:2.0:1783071388.386028:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071388.386037:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684485888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071388.386081:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684485888:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071388.386087:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1783071388.386106:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783071388.386328:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa785880 x1869685684485888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071388.386342:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684485888:0@lo:400:kworker.0 00000004:00080000:1.0:1783071388.386477:0:8047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289760801755ns, next at 290760800177ns, rc = 0 00000100:00100000:0.0:1783071388.388390:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071388.388430:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684486016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071388.388517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071388.388588:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485504 00000100:00100000:0.0:1783071388.388597:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485504 00000100:00100000:0.0:1783071388.388654:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485632 00000100:00100000:0.0:1783071388.388657:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485632 00000100:00100000:0.0:1783071388.388737:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684485760 00000100:00100000:0.0:1783071388.388740:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684485760 00000100:00100000:0.0:1783071388.388760:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783071388.388768:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684485504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.388823:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684485504:12345-0@lo:400:kworker.0 Request processed in 55us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071388.388831:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783071388.388853:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783071388.388859:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684485632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.388886:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684485632:12345-0@lo:400:kworker.0 Request processed in 27us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071388.388891:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783071388.388902:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783071388.388908:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684485760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.388955:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684485760:12345-0@lo:400:kworker.0 Request processed in 47us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071388.388962:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783071388.389010:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486016 00000100:00100000:0.0:1783071388.389013:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486016 00000100:00100000:0.0:1783071388.389037:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071388.389043:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684486016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071388.389069:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071388.389104:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684486016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071388.389110:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1783071388.389147:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d59180 x1869685684486016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071388.389166:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684486016:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783071388.389186:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071388.389230:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684485760:0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.389255:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684485632:0@lo:400:kworker.0 00000100:00100000:0.0:1783071388.389266:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684485504:0@lo:400:kworker.0 00000001:00080000:1.0:1783071388.498641:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:1.0:1783071388.502159:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1783071388.502350:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1783071388.502361:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783071388.502624:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684486144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783071388.502721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071388.503432:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486144 00000100:00100000:1.0:1783071388.503446:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486144 00000100:00100000:1.0:1783071388.503511:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783071388.503521:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684486144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783071388.503548:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1783071388.503585:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a478297, atime: 0x6a478297, ctime: 0x6a478297, blocks: 0x1 00010000:00010000:1.0:1783071388.503594:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071388.503613:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=289s v=(0 0) 00010000:00010000:1.0:1783071388.503628:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071388.503634:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071388.503653:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071388.503709:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071388.503718:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071388.503743:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071388.504089:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071388.504097:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071388.504105:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071388.504110:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071388.504119:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071388.504140:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071388.504148:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ff40b5/0xd360fc6ce6ec73b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071388.504170:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071388.504172:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071388.504174:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071388.511265:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684486144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7737us (8536us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783071388.511279:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1783071388.511466:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782faf2e300/2, rc 0, transno 4294967300 00000100:00100000:0.0:1783071388.511474:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684486144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783071388.833111:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071389.247706:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.247828:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583616 00000100:00100000:0.0:1783071389.247855:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583616 00000100:00100000:0.0:1783071389.247916:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:0.0:1783071389.247925:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:5569:x1869685665583616:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071389.247942:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071389.247961:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec73bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8f3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.247990:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec73bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8f3 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.248000:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec73bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8f3 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.248009:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8400, rc 0) 00000100:00100000:0.0:1783071389.248071:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665583616:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 146us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.248078:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:3.0:1783071389.251412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.251519:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583744 00000100:00100000:0.0:1783071389.251528:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583744 00000100:00100000:0.0:1783071389.251585:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:0.0:1783071389.251595:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665583744:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.252266:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665583744:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 669us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.252277:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 242 00000100:00100000:1.0:1783071389.258032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.258158:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665583872 00000100:00100000:0.0:1783071389.258169:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665583872 00000100:00100000:0.0:1783071389.258230:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:0.0:1783071389.258240:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665583872:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.258483:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665583872:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 244us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.258492:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 243 00000100:00100000:3.0:1783071389.261341:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.261502:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584000 00000100:00100000:0.0:1783071389.261511:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584000 00000100:00100000:0.0:1783071389.261575:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:0.0:1783071389.261584:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:9916:x1869685665584000:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071389.262033:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:9916:x1869685665584000:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 449us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.262042:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 244 00000100:00100000:1.0:1783071389.264202:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071389.264335:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584128 00000100:00100000:3.0:1783071389.264344:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584128 00000100:00100000:3.0:1783071389.264397:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:3.0:1783071389.264407:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:9916:x1869685665584128:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071389.264642:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:9916:x1869685665584128:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 237us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.264650:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 245 00000100:00100000:1.0:1783071389.272955:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.273453:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584256 00000100:00100000:0.0:1783071389.273464:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584256 00000100:00100000:0.0:1783071389.273515:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:0.0:1783071389.273524:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:5569:x1869685665584256:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071389.273541:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071389.273557:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec73c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca8fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.273584:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec73c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8fa expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.273594:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec73c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8fa expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.273604:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9000, rc 0) 00000100:00100000:0.0:1783071389.273666:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665584256:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 143us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.274443:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 246 00000100:00100000:0.0:1783071389.276154:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071389.276243:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584384 00000100:00100000:3.0:1783071389.276252:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584384 00000100:00100000:3.0:1783071389.276306:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:3.0:1783071389.276316:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665584384:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.276628:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665584384:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 312us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.276636:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:1.0:1783071389.292170:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071389.292454:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584512 00000100:00100000:0.0:1783071389.292465:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584512 00000100:00100000:0.0:1783071389.292523:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:0.0:1783071389.292533:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665584512:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.292817:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:5569:x1869685665584512:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 284us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.292826:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 248 00000100:00100000:1.0:1783071389.311581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071389.312049:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584640 00000100:00100000:2.0:1783071389.312061:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584640 00000100:00100000:2.0:1783071389.312126:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:2.0:1783071389.312137:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:9919:x1869685665584640:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071389.312410:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:9919:x1869685665584640:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 274us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.312427:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 249 00000100:00100000:1.0:1783071389.323072:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071389.323161:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584768 00000100:00100000:3.0:1783071389.323172:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584768 00000100:00100000:3.0:1783071389.323231:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:3.0:1783071389.323241:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:9919:x1869685665584768:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071389.323523:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:9919:x1869685665584768:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 283us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.323531:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 250 00000100:00100000:1.0:1783071389.633481:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071389.633509:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071389.633560:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071389.633587:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665584896 00000100:00100000:3.0:1783071389.633599:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665584896 00000100:00100000:3.0:1783071389.633698:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585152 00000100:00100000:3.0:1783071389.633702:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585152 00000100:00100000:3.0:1783071389.633743:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:3.0:1783071389.633752:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665584896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071389.633846:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665584896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.633854:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:3.0:1783071389.633872:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1783071389.633879:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665585152:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071389.633905:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665585152:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.633910:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00080000:1.0:1783071389.633989:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071389.640731:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585024 00000100:00100000:2.0:1783071389.640749:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585024 00000100:00100000:2.0:1783071389.640872:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:2.0:1783071389.640884:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665585024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071389.640967:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665585024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 86us (7406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.640976:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00080000:1.0:1783071389.641882:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1783071389.857055:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071389.857065:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0f800 from 7 10000000:01000000:0.0:1783071389.857073:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071389.857108:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071389.857123:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.857137:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.857148:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071389.857176:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.857254:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.857320:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1783071389.857500:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486272 00000100:00100000:1.0:1783071389.857508:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486272 00000100:00100000:1.0:1783071389.857563:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783071389.857572:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:5788:x1869685684486272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071389.857585:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071389.857642:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c13d6400/0xd360fc6ce6ec73d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec73cb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071389.857694:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c13d6400/0xd360fc6ce6ec73d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73cb expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071389.857706:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c13d6400/0xd360fc6ce6ec73d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73cb expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071389.857724:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d6400, rc 0) 00000100:00100000:1.0:1783071389.857774:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071389.857782:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783071389.857962:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071389.857976:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.857994:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071389.858058:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.858085:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.858114:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.858167:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486400 00000100:00100000:2.0:1783071389.858173:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486400 00000100:00100000:2.0:1783071389.858205:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1783071389.858214:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.858490:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.858497:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783071389.858816:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.858850:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.858892:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.858918:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1783071389.859021:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486528 00000100:00100000:1.0:1783071389.859026:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486528 00000100:00100000:1.0:1783071389.859066:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783071389.859073:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071389.859211:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071389.859218:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783071389.859379:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.860185:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11530:1869685684486656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071389.860224:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.860257:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1783071389.860315:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486656 00000100:00100000:3.0:1783071389.860320:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486656 00000100:00100000:3.0:1783071389.860355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783071389.860362:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:11530:x1869685684486656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071389.860519:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:11530:x1869685684486656:12345-0@lo:502:llog_process_th.0 Request processed in 158us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.860526:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783071389.861133:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11530:1869685684486656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783071389.861163:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783071389.861173:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071389.861175:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783071389.861181:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9782c7f0f800 00000020:00000080:0.0:1783071389.861184:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783071389.861260:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11530:1869685684486784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071389.861296:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.861365:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071389.862718:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486784 00000100:00100000:1.0:1783071389.862729:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486784 00000100:00100000:1.0:1783071389.862791:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783071389.862801:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:11530:x1869685684486784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071389.863033:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:11530:x1869685684486784:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071389.863041:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783071389.863137:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11530:1869685684486784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783071389.863179:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071389.863185:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071389.863188:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783071389.863192:0:11530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783071389.863359:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783071389.863387:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071389.863398:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.863410:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071389.863420:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783071389.863422:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782f9bac800 from 7 10000000:01000000:3.0:1783071389.863425:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783071389.863457:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.863465:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.863474:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071389.863493:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.863530:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071389.863563:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071389.863898:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684486912 00000100:00100000:0.0:1783071389.863903:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684486912 00000100:00100000:0.0:1783071389.863935:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783071389.863942:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:5788:x1869685684486912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071389.863953:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071389.863966:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8e00/0xd360fc6ce6ec73e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec73d9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.863987:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8e00/0xd360fc6ce6ec73e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73d9 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.863997:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b8e00/0xd360fc6ce6ec73e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73d9 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.864007:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8e00, rc 0) 00000100:00100000:0.0:1783071389.864625:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684486912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 680us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071389.864632:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783071389.864909:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684486912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071389.864927:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.864937:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071389.864995:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.870077:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071389.870138:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797d900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.870456:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487040 00000100:00100000:2.0:1783071389.870467:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487040 00000100:00100000:2.0:1783071389.870533:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783071389.870543:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684487040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.870888:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684487040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.870895:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783071389.871051:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.871105:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.871152:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071389.871183:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783071389.871199:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487168 00000100:00100000:3.0:1783071389.871203:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487168 00000100:00100000:3.0:1783071389.871231:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783071389.871251:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684487168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.871393:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684487168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.871400:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783071389.871435:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071389.871716:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11532:1869685684487296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071389.871751:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071389.871770:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487296 00000100:00100000:3.0:1783071389.871774:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487296 00000100:00100000:3.0:1783071389.871812:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783071389.871819:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:11532:x1869685684487296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071389.871951:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:11532:x1869685684487296:12345-0@lo:502:llog_process_th.0 Request processed in 132us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.871957:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783071389.871990:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071389.872001:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11532:1869685684487296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071389.872030:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071389.872040:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071389.872043:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071389.872050:0:11532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9782f9bac800 00000020:00000080:3.0:1783071389.872052:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071389.872118:0:11532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11532:1869685684487424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071389.872148:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071389.872165:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487424 00000100:00100000:3.0:1783071389.872168:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487424 00000100:00100000:3.0:1783071389.872187:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783071389.872192:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:11532:x1869685684487424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071389.872290:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:11532:x1869685684487424:12345-0@lo:502:llog_process_th.0 Request processed in 96us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.872297:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783071389.872327:0:11532:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071389.872338:0:11532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11532:1869685684487424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071389.872357:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071389.872361:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071389.872362:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783071389.872366:0:11532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783071389.873134:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783071389.873161:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783071389.873174:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.873186:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071389.873206:0:5788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071389.873209:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c8344000 from 7 10000000:01000000:0.0:1783071389.873212:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071389.873243:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.873253:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.873263:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071389.873279:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.873317:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.873349:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071389.876938:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487552 00000100:00100000:3.0:1783071389.876954:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487552 00000100:00100000:3.0:1783071389.877017:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783071389.877027:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:5788:x1869685684487552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071389.877043:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071389.877061:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c4ef1c00/0xd360fc6ce6ec73ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec73e7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.877103:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c4ef1c00/0xd360fc6ce6ec73ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73e7 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.877115:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c4ef1c00/0xd360fc6ce6ec73ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec73e7 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071389.877124:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1c00, rc 0) 00000100:00100000:3.0:1783071389.877208:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684487552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071389.877215:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783071389.877663:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071389.877815:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071389.877826:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071389.877901:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071389.877941:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071389.877974:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.878166:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487680 00000100:00100000:2.0:1783071389.878172:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487680 00000100:00100000:2.0:1783071389.878204:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783071389.878211:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684487680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.878475:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684487680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.878482:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783071389.878537:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.878565:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.878600:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071389.878629:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3e20cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.878641:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487808 00000100:00100000:2.0:1783071389.878645:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487808 00000100:00100000:2.0:1783071389.878663:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783071389.878668:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684487808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.878985:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:5788:x1869685684487808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.878992:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783071389.879027:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:5788:1869685684487808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071389.879262:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11533:1869685684487936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071389.879294:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071389.879316:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684487936 00000100:00100000:2.0:1783071389.879319:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684487936 00000100:00100000:2.0:1783071389.879337:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783071389.879344:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:11533:x1869685684487936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071389.879457:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:11533:x1869685684487936:12345-0@lo:502:llog_process_th.0 Request processed in 112us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.879469:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783071389.879505:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3e20540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.879517:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11533:1869685684487936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071389.879539:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071389.879550:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071389.879552:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783071389.879560:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9782c8344000 00000020:00000080:2.0:1783071389.879562:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783071389.880022:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11533:1869685684488064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071389.880063:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071389.880084:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488064 00000100:00100000:2.0:1783071389.880087:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488064 00000100:00100000:2.0:1783071389.880112:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783071389.880118:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:11533:x1869685684488064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071389.880248:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:11533:x1869685684488064:12345-0@lo:502:llog_process_th.0 Request processed in 128us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071389.880255:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783071389.880289:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2945900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071389.880301:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:11533:1869685684488064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783071389.880320:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071389.880325:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071389.880327:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783071389.880331:0:11533:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783071389.880382:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783071389.880402:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071389.880411:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071389.880427:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071389.906450:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071390.881568:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071390.945399:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071391.905583:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071392.929036:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071392.993231:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684488192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071392.993317:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071392.993661:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488192 00000100:00100000:1.0:1783071392.993670:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488192 00000100:00100000:1.0:1783071392.993760:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783071392.993770:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684488192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071392.993807:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071392.993864:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684488192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071392.993872:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1783071392.993933:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783071392.994026:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d58700 x1869685684488192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071392.994045:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684488192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071393.504961:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684488448:0@lo:400:kworker.0 00000100:00100000:0.0:1783071393.505058:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071393.505124:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071393.505131:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684488576:0@lo:400:kworker.0 00000100:00100000:0.0:1783071393.505153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071393.505297:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684488320:0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.505330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071393.505357:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684488832:0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.505380:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071393.505396:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071393.505400:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684488704:0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.505426:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488320 00000100:00100000:2.0:1783071393.505434:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488320 00000100:00100000:2.0:1783071393.505479:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783071393.505487:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684488320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.505553:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684488320:12345-0@lo:400:kworker.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071393.505561:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783071393.505632:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488832 00000100:00100000:2.0:1783071393.505635:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488832 00000100:00100000:2.0:1783071393.505668:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783071393.505713:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1869685684488832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.505759:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1869685684488832:12345-0@lo:400:kworker.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071393.505765:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783071393.508161:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071393.508762:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071393.509933:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783071393.509955:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684488960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071393.510028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071393.510069:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488960 00000100:00100000:1.0:1783071393.510076:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488960 00000100:00100000:1.0:1783071393.510121:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071393.510130:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684488960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071393.513309:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071393.513436:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684488960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3302us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071393.513448:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071393.514879:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684488960:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1783071393.518434:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1783071393.519196:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684488320:0@lo:400:kworker.0 00000100:00100000:3.0:1783071393.519219:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684488832:0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.521204:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488448 00000100:00100000:2.0:1783071393.521216:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488448 00000100:00100000:2.0:1783071393.521284:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488576 00000100:00100000:2.0:1783071393.521288:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488576 00000100:00080000:2.0:1783071393.521309:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071393.521324:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684488704 00000100:00100000:2.0:1783071393.521328:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684488704 00000100:00080000:2.0:1783071393.521340:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071393.521358:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071393.521367:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684488448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.521463:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684488448:12345-0@lo:400:kworker.0 Request processed in 97us (16405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071393.521471:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783071393.521515:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684488448:0@lo:400:kworker.0 00000100:00100000:3.0:1783071393.521545:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783071393.521557:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684488576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.521561:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071393.521573:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071393.521633:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684488576:12345-0@lo:400:kworker.0 Request processed in 79us (16478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071393.521642:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783071393.521642:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684488704:12345-0@lo:400:kworker.0 Request processed in 70us (12881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071393.521654:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783071393.521710:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684488576:0@lo:400:kworker.0 00000100:00100000:2.0:1783071393.521741:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684488704:0@lo:400:kworker.0 00000001:00080000:3.0:1783071393.556699:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1783071393.954257:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071394.752454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071394.752495:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071394.752522:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071394.752542:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071394.752578:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585536 00000100:00100000:1.0:1783071394.752605:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585536 00000100:00100000:1.0:1783071394.752698:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071394.752710:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071394.752790:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071394.752797:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00080000:2.0:1783071394.752984:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071394.753016:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585408 00000100:00100000:2.0:1783071394.753020:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585408 00000100:00100000:2.0:1783071394.753073:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585664 00000100:00100000:2.0:1783071394.753077:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585664 00000100:00100000:2.0:1783071394.753097:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:2.0:1783071394.753104:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071394.753143:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 39us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071394.753150:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:2.0:1783071394.753190:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:2.0:1783071394.753197:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665585664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071394.753225:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665585664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071394.753231:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00080000:0.0:1783071394.753290:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071394.753394:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585280 00000100:00100000:3.0:1783071394.753404:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585280 00000100:00100000:3.0:1783071394.753468:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 267 00000100:00100000:3.0:1783071394.753477:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665585280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071394.753505:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665585280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071394.753511:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 267 00010000:00010000:2.0:1783071394.978036:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071396.001671:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071397.029466:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071398.049385:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071398.113243:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684489088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071398.113313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071398.113664:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489088 00000100:00100000:1.0:1783071398.113689:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489088 00000100:00100000:1.0:1783071398.113789:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783071398.113799:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684489088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071398.113849:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071398.114120:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684489088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071398.114129:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1783071398.114351:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783071398.114474:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9d58700 x1869685684489088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071398.114494:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684489088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071398.625905:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684489216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626034:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071398.626079:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684489728:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626105:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071398.626142:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783071398.626148:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684489344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626171:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071398.626196:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684489472:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071398.626340:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071398.626347:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684489600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071398.626405:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489216 00000100:00100000:3.0:1783071398.626412:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489216 00000100:00100000:3.0:1783071398.626494:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783071398.626504:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684489216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626577:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684489216:12345-0@lo:400:kworker.0 Request processed in 73us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071398.626585:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783071398.626618:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489728 00000100:00100000:3.0:1783071398.626621:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489728 00000100:00100000:3.0:1783071398.626656:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783071398.626662:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684489728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626716:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684489728:12345-0@lo:400:kworker.0 Request processed in 53us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071398.626722:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783071398.626739:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489344 00000100:00100000:3.0:1783071398.626742:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489344 00000100:00100000:3.0:1783071398.626761:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489472 00000100:00100000:3.0:1783071398.626764:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489472 00000100:00100000:3.0:1783071398.626777:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489600 00000100:00100000:3.0:1783071398.626779:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489600 00000100:00100000:3.0:1783071398.626794:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071398.626800:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684489344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626830:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684489344:12345-0@lo:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071398.626836:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783071398.626848:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783071398.626854:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684489472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626884:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684489472:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071398.626890:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783071398.626901:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783071398.626916:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.626944:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684489600:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071398.626950:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1783071398.626975:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783071398.626980:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071398.627006:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684489600:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.627017:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684489472:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.627046:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684489344:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.627054:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684489216:0@lo:400:kworker.0 00000100:00100000:3.0:1783071398.627062:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1783071398.627067:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782faf2e300, transno 4294967300 00000100:00100000:3.0:1783071398.627075:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684489728:0@lo:400:kworker.0 00000100:00100000:1.0:1783071398.631178:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071398.631199:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684489856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071398.631266:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071398.631305:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489856 00000100:00100000:1.0:1783071398.631312:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489856 00000100:00100000:1.0:1783071398.631353:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071398.631362:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684489856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071398.631392:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071398.631433:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684489856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071398.631441:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071398.631498:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684489856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783071399.073315:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071399.874170:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071399.874214:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071399.874243:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071399.874282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071399.874365:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586048 00000100:00100000:1.0:1783071399.874375:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586048 00000100:00100000:1.0:1783071399.874601:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1783071399.874613:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665586048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071399.874722:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665586048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 111us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071399.874730:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00080000:0.0:1783071399.874896:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071399.874953:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585792 00000100:00100000:2.0:1783071399.874958:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585792 00000100:00100000:2.0:1783071399.875002:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 269 00000100:00100000:2.0:1783071399.875010:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665585792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071399.875053:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665585792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071399.875078:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 269 00000100:00100000:3.0:1783071399.875318:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665585920 00000100:00100000:3.0:1783071399.875324:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665585920 00000100:00080000:0.0:1783071399.875539:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071399.875565:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586176 00000100:00100000:0.0:1783071399.875569:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586176 00000100:00100000:0.0:1783071399.875623:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:0.0:1783071399.875632:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665586176:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071399.875704:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665586176:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 72us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071399.875711:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:3.0:1783071399.875786:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:3.0:1783071399.875794:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071399.875825:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665585920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071399.875831:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00080000:1.0:1783071399.875900:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071400.097780:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071400.162592:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783071401.121014:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071402.147055:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071403.173483:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071403.233778:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684489984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071403.233851:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.234332:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684489984 00000100:00100000:1.0:1783071403.234341:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684489984 00000100:00100000:1.0:1783071403.234475:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071403.234486:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684489984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071403.234611:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783071403.234727:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071403.234785:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684489984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071403.234794:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783071403.245108:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa368e00 x1869685684489984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071403.245175:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684489984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071403.746238:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071403.746313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747208:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684490240:0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.747249:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747273:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684490752:0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.747299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747320:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071403.747325:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684490368:0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.747366:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747393:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684490496:0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.747424:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747441:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071403.747445:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa36b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684490624:0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.747465:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071403.747492:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490752 00000100:00100000:1.0:1783071403.747508:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490752 00000100:00100000:0.0:1783071403.747884:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490368 00000100:00100000:0.0:1783071403.747889:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490368 00000100:00100000:0.0:1783071403.747954:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490496 00000100:00100000:0.0:1783071403.747958:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490496 00000100:00100000:0.0:1783071403.747976:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783071403.747984:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684490368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071403.748042:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684490368:12345-0@lo:400:kworker.0 Request processed in 57us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071403.748059:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783071403.748074:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783071403.748080:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684490496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071403.748113:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684490496:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071403.748118:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783071403.748163:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684490496:0@lo:400:kworker.0 00000100:00100000:0.0:1783071403.748193:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684490368:0@lo:400:kworker.0 00000100:00100000:0.0:1783071403.748216:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490112 00000100:00100000:0.0:1783071403.748219:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490112 00000100:00100000:0.0:1783071403.748243:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071403.748250:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684490112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783071403.748276:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071403.748306:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684490112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071403.748312:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783071403.748338:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490624 00000100:00100000:0.0:1783071403.748342:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490624 00000100:00100000:0.0:1783071403.748365:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071403.748371:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684490624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071403.748403:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684490624:12345-0@lo:400:kworker.0 Request processed in 33us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071403.748408:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783071403.748434:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa36b800 x1869685684490624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071403.748455:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa36b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684490624:0@lo:400:kworker.0 00000100:00080000:0.0:1783071403.748477:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071403.748481:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071403.748720:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071403.748729:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684490752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071403.748765:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684490752:12345-0@lo:400:kworker.0 Request processed in 39us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071403.748771:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783071403.748898:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684490752:0@lo:400:kworker.0 00000100:00100000:2.0:1783071403.749256:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071403.749461:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490240 00000100:00100000:3.0:1783071403.749468:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490240 00000100:00100000:3.0:1783071403.749514:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783071403.749523:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684490240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071403.749572:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684490240:12345-0@lo:400:kworker.0 Request processed in 52us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071403.749580:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783071403.749634:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684490240:0@lo:400:kworker.0 00010000:00010000:2.0:1783071404.194061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071404.991968:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071404.992016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071404.992163:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586304 00000100:00100000:0.0:1783071404.992173:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586304 00000100:00100000:0.0:1783071404.992234:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:0.0:1783071404.992245:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665586304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071404.992324:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665586304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071404.992332:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:3.0:1783071404.992541:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586432 00000100:00100000:3.0:1783071404.992546:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586432 00000100:00100000:3.0:1783071404.992586:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:3.0:1783071404.992592:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665586432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071404.992621:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665586432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071404.992627:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00080000:0.0:1783071404.992695:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071405.024940:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071405.024994:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071405.025142:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586560 00000100:00100000:1.0:1783071405.025153:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586560 00000100:00100000:1.0:1783071405.025240:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071405.025250:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2354:x1869685665586560:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:1.0:1783071405.025289:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec732a 00000100:00080000:1.0:1783071405.025300:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9782fa848000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071405.025352:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1783071405.025660:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+2:2354:x1869685665586560:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 410us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071405.025668:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1783071405.026874:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586688 00000100:00100000:2.0:1783071405.026887:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586688 00000100:00100000:2.0:1783071405.026965:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1783071405.026976:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665586688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071405.027069:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2356:x1869685665586688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 91us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071405.027076:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00010000:00010000:2.0:1783071405.027100:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071405.027500:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783071405.027507:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783071405.217255:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071406.241017:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071407.265009:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071408.291968:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071408.357392:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071408.357418:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071408.358825:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071408.359339:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684490880 00000100:00100000:2.0:1783071408.359348:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684490880 00000100:00100000:2.0:1783071408.359420:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783071408.359432:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684490880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071408.360002:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783071408.360126:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071408.360749:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684490880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1317us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071408.360767:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1783071408.360885:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9be0000 x1869685684490880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071408.360906:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071408.867614:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071408.867636:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684491008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071408.867725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071408.868467:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491008 00000100:00100000:1.0:1783071408.868478:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491008 00000100:00100000:1.0:1783071408.868534:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783071408.868545:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684491008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071408.868589:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071408.868644:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684491008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071408.868651:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1783071408.868704:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071408.869056:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684491008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071408.870438:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684491264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870509:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071408.870542:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071408.870548:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684491392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870586:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071408.870620:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491264 00000100:00100000:0.0:1783071408.870627:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491264 00000100:00100000:0.0:1783071408.870666:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491392 00000100:00100000:0.0:1783071408.870670:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491392 00000100:00100000:0.0:1783071408.870721:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783071408.870730:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684491264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870787:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684491264:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071408.870794:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783071408.870809:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783071408.870816:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870841:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684491392:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071408.870846:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783071408.870872:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684491520:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071408.870926:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783071408.870931:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684491136:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870958:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071408.870977:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684491648:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.870997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071408.871020:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491520 00000100:00100000:0.0:1783071408.871023:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491520 00000100:00100000:0.0:1783071408.871048:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071408.871055:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871088:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684491520:12345-0@lo:400:kworker.0 Request processed in 34us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071408.871093:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783071408.871109:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491136 00000100:00100000:0.0:1783071408.871112:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491136 00000100:00100000:0.0:1783071408.871132:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1783071408.871137:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684491136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871169:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3294:x1869685684491136:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071408.871174:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1783071408.871201:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071408.871220:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3294:1869685684491136:0@lo:400:kworker.0 00010000:00080000:0.0:1783071408.871232:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782fa26f100 x1869685684491520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071408.871241:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684491520:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871262:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684491392:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871270:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684491264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871283:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491648 00000100:00100000:0.0:1783071408.871285:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491648 00000100:00100000:0.0:1783071408.871308:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783071408.871313:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684491648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071408.871341:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684491648:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071408.871346:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1783071408.871359:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071408.871373:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684491648:0@lo:400:kworker.0 00000001:00100000:3.0:1783071408.957571:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:3.0:1783071408.957580:0:7495:0:(genops.c:906:class_export_put()) final put ffff9782c67f8000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071408.961208:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c67f8000/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-OST0001 00000020:00000080:1.0:1783071408.961277:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782fa848000 for lustre-OST0001 00010000:00010000:1.0:1783071409.313844:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071410.112179:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071410.112226:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071410.112257:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071410.112285:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586944 00000100:00100000:0.0:1783071410.112294:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586944 00000100:00100000:0.0:1783071410.112357:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587072 00000100:00100000:0.0:1783071410.112361:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587072 00000100:00100000:0.0:1783071410.112379:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:0.0:1783071410.112388:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665586944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071410.112465:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665586944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071410.112472:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:0.0:1783071410.112488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:0.0:1783071410.112494:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665587072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071410.112515:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665587072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071410.112521:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00080000:0.0:1783071410.112535:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071410.112589:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665586816 00000100:00100000:3.0:1783071410.112593:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665586816 00000100:00100000:3.0:1783071410.112623:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 273 00000100:00100000:3.0:1783071410.112630:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665586816:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071410.112666:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665586816:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071410.112700:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 273 00010000:00010000:0.0:1783071410.337948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071410.401296:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783071411.360942:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783071411.509960:0:11698:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:36:51 (1783071411) 00010000:00010000:0.0:1783071412.385017:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071412.661513:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071412.662003:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587200 00000100:00100000:0.0:1783071412.662019:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587200 00000100:00100000:0.0:1783071412.662345:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1783071412.662361:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:10187:x1869685665587200:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071412.662380:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071412.662400:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec73f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca901 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662468:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662493:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662503:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071412.662721:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783071412.662724:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071412.662792:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662814:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec73f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca901 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662830:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca901 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.662837:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071412.662840:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071412.662844:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071412.662910:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:10187:x1869685665587200:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 556us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071412.662918:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00080000:2.0:1783071412.664262:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071412.669795:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071412.669950:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587328 00000100:00100000:0.0:1783071412.669960:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587328 00000100:00100000:0.0:1783071412.670026:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1783071412.670036:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:10188:x1869685665587328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071412.670060:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071412.670092:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca908 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670156:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670170:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670182:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670196:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670203:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670210:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670580:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670590:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.670598:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071412.670926:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783071412.670931:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071412.671059:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671080:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671087:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671094:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671099:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071412.671102:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671110:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671122:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071412.671125:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071412.671130:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671136:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec740a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671147:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671152:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671158:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671168:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071412.671171:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671176:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671184:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9782cc2b6c00) 00010000:00010000:0.0:1783071412.671187:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071412.671190:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671196:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671225:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca908 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671238:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca908 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.671246:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782cc2b6b00) 00010000:00010000:0.0:1783071412.671248:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071412.671250:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9e00, rc 0) 00000100:00100000:0.0:1783071412.671360:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:10188:x1869685665587328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1324us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071412.671368:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1783071412.675073:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071412.678788:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587584 00000100:00100000:0.0:1783071412.678954:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587584 00000100:00100000:0.0:1783071412.679329:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1783071412.679340:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:10188:x1869685665587584:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071412.679371:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071412.679392:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec741f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca90f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679475:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679490:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679501:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679551:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679559:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.679571:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.685754:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7434 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.685777:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7434 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.685787:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7434 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071412.685824:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783071412.687905:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687921:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687928:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687934:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071412.687938:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687945:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687959:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782cc2b6b00) 00010000:00010000:0.0:1783071412.687962:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071412.687967:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687972:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7426 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687986:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.687992:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.688516:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.688522:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071412.688526:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.688533:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.688542:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9782cc2b6400) 00010000:00010000:0.0:1783071412.688545:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071412.688549:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.688555:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec742d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.689384:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec741f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca90f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.689405:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7434 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca90f expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071412.689413:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:0.0:1783071412.689415:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071412.689418:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9a00, rc 0) 00000100:00100000:0.0:1783071412.689503:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10188:x1869685665587584:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 10164us (14438us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783071412.689523:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1783071412.692232:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071412.692447:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587712 00000100:00100000:0.0:1783071412.692457:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587712 00000100:00100000:0.0:1783071412.692555:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1783071412.692564:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10188:x1869685665587712:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783071412.692755:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10188:x1869685665587712:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 191us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071412.692763:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00010000:00010000:1.0:1783071413.417299:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071413.472820:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071413.472844:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684491776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071413.472916:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071413.472984:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491776 00000100:00100000:1.0:1783071413.472999:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491776 00000100:00100000:1.0:1783071413.473055:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783071413.473066:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684491776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071413.473104:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071413.473151:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684491776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071413.473158:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783071413.473300:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783071413.473338:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9be0a80 x1869685684491776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071413.473355:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684491776:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783071413.475872:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783071413.986460:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684492160:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.986586:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783071413.986592:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684492032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.986632:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684492544:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.986716:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492160 00000100:00100000:3.0:1783071413.986723:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492160 00000100:00100000:3.0:1783071413.986770:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492032 00000100:00100000:3.0:1783071413.986772:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492032 00000100:00100000:3.0:1783071413.986788:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071413.986795:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684492160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986842:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684492160:12345-0@lo:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.986847:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783071413.986860:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071413.986863:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986878:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684492032:12345-0@lo:400:kworker.0 Request processed in 15us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.986882:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783071413.986907:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492544 00000100:00100000:3.0:1783071413.986910:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492544 00000100:00100000:3.0:1783071413.986930:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071413.986934:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684492544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986956:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684492544:12345-0@lo:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.986960:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783071413.986988:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684492032:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986994:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684492544:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.986999:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684492160:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987146:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684491904:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987204:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.987229:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684492416:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987254:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.987282:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071413.987288:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684492288:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071413.987332:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492416 00000100:00100000:0.0:1783071413.987334:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492416 00000100:00100000:0.0:1783071413.987352:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783071413.987356:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987384:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684492416:12345-0@lo:400:kworker.0 Request processed in 27us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.987398:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1783071413.987427:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071413.987432:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071413.987565:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684491904 00000100:00100000:0.0:1783071413.987569:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684491904 00000100:00100000:0.0:1783071413.987592:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783071413.987599:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987628:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684491904:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.987635:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783071413.987657:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492288 00000100:00100000:0.0:1783071413.987660:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492288 00000100:00100000:0.0:1783071413.987695:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783071413.987700:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987720:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684492288:12345-0@lo:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071413.987723:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1783071413.987741:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9782f9bcea00 x1869685684492288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783071429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071413.987750:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684492288:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987755:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684491904:0@lo:400:kworker.0 00000100:00100000:0.0:1783071413.987759:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684492416:0@lo:400:kworker.0 00000100:00100000:3.0:1783071413.989081:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071413.989098:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684492672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071413.989148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071413.989244:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684492672 00000100:00100000:3.0:1783071413.989251:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684492672 00000100:00100000:3.0:1783071413.989289:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071413.989295:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684492672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071413.989321:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071413.989349:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684492672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071413.989354:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071413.989383:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684492672:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1783071414.032669:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1783071414.108084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.108330:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665587840 00000100:00100000:3.0:1783071414.108340:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665587840 00000100:00100000:3.0:1783071414.108424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1783071414.108436:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:10230:x1869685665587840:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071414.108464:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.108484:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca916 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108550:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108566:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108579:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108594:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108602:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108609:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108901:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108909:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108916:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108921:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.108930:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108939:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108950:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:3.0:1783071414.108953:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.108957:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108964:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108974:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108981:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108986:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.108991:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.108994:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109000:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109006:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9782d9936000) 00010000:00010000:3.0:1783071414.109009:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.109017:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109023:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109071:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7442 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca916 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109082:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:3.0:1783071414.109084:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.109088:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca916 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.109097:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1a00, rc 0) 00000100:00100000:3.0:1783071414.109155:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:10230:x1869685665587840:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 721us (1078us total) trans 0 rc 301/301 00000100:00100000:3.0:1783071414.109173:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00080000:1.0:1783071414.109256:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071414.114302:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.114375:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588096 00000100:00100000:2.0:1783071414.114385:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588096 00000100:00100000:2.0:1783071414.114447:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1783071414.114458:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:10230:x1869685665588096:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:2.0:1783071414.114514:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071414.114539:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec73fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca901 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114557:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071414.114568:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071414.114882:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114895:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114904:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114914:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114931:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.114937:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071414.116322:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783071414.116336:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116345:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116352:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116358:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071414.116362:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116370:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116383:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d9b38400) 00010000:00010000:2.0:1783071414.116386:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071414.116389:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.116395:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7457 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071414.116435:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038c3bf11 reply state 00000000eb943168 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071414.116444:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071414.116604:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10230:x1869685665588096:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 2144us (2307us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783071414.116612:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00010000:00010000:3.0:1783071414.119998:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120018:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120026:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120033:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.120038:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120053:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120233:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9782d9b38900) 00010000:00010000:3.0:1783071414.120235:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.120238:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.120243:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec745e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071414.194552:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.195759:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588224 00000100:00100000:1.0:1783071414.195772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588224 00000100:00100000:1.0:1783071414.195844:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1783071414.195855:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:10238:x1869685665588224:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:1.0:1783071414.195880:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071414.195907:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec7465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca91d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.195980:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.195996:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.196020:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071414.196086:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783071414.196090:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071414.196130:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.196171:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec7465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca91d expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.196188:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca91d expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.196196:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:1.0:1783071414.196199:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071414.196202:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d6a00, rc 0) 00000100:00100000:1.0:1783071414.196276:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10238:x1869685665588224:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 423us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071414.196284:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1783071414.252587:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.252725:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588352 00000100:00100000:3.0:1783071414.252735:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588352 00000100:00100000:3.0:1783071414.252799:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1783071414.252808:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:10244:x1869685665588352:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071414.252827:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.252847:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca924 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252907:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252921:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252932:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252944:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252963:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.252970:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253069:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253076:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253082:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071414.253108:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783071414.253111:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071414.253142:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253154:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253160:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253167:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253173:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.253177:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253189:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253201:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:3.0:1783071414.253203:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.253207:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253214:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec747a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253226:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253232:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253238:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253243:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.253245:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253250:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253256:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9782d9936000) 00010000:00010000:3.0:1783071414.253258:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.253260:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253273:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253302:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca924 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253314:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca924 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.253321:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071414.253323:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071414.253326:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1600, rc 0) 00000100:00100000:2.0:1783071414.253980:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:10244:x1869685665588352:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1168us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071414.253990:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1783071414.259080:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.259178:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588608 00000100:00100000:1.0:1783071414.259188:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588608 00000100:00100000:0.0:1783071414.259340:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:0.0:1783071414.259350:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:10244:x1869685665588608:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1783071414.259395:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071414.259429:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec748f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca92b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259594:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259619:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259632:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259710:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259719:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.259727:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071414.260365:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1783071414.260553:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260565:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260572:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260619:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260626:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260632:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260638:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071414.260642:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260650:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260662:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071414.260666:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071414.260696:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260703:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7496 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071414.260716:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027edf99d reply state 00000000f0c8e1b1 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.260726:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783071414.260760:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec748f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260788:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.260795:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:0.0:1783071414.260797:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071414.260800:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8800, rc 0) 00000100:00100000:0.0:1783071414.261306:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10244:x1869685665588608:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1956us (2237us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783071414.261315:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00010000:00010000:0.0:1783071414.265271:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265291:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265298:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265305:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071414.265309:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265317:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265335:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782cc2b6700) 00010000:00010000:0.0:1783071414.265338:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071414.265344:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.265365:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec749d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.267091:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.267270:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588736 00000100:00100000:3.0:1783071414.267279:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588736 00000100:00100000:3.0:1783071414.267316:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1783071414.267323:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1869685665588736:12345-192.168.202.16@tcp:8:bash.0 00010000:00080000:3.0:1783071414.267352:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1783071414.267382:0:6588:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec74b2 00002000:00100000:3.0:1783071414.267392:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a/ffff9782c3011800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071414.267399:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071414.267934:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783071414.267966:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9782c3010800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071414.268112:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665588736:12345-192.168.202.16@tcp:8:bash.0 Request processed in 787us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.268120:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1783071414.275814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071414.276014:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588864 00000100:00100000:0.0:1783071414.276024:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588864 00000100:00100000:0.0:1783071414.276150:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1783071414.276162:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:0:x1869685665588864:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1783071414.276179:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071414.276200:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca932 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071414.276227:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071414.276247:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1783071414.276252:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071414.276260:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.276280:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.276293:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8000, rc 0) 00000100:00100000:0.0:1783071414.276357:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:0:x1869685665588864:12345-192.168.202.16@tcp:101:bash.0 Request processed in 197us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071414.276364:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00080000:1.0:1783071414.277852:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071414.279773:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071414.283969:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665588992 00000100:00100000:0.0:1783071414.284001:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665588992 00000100:00100000:0.0:1783071414.284107:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1783071414.284119:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:10244:x1869685665588992:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1783071414.284137:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071414.284155:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca939 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.284188:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.284197:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071414.284201:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071414.284205:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.284251:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.284265:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.284278:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6587:1869685684492800:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071414.284381:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071414.286468:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6587:1869685684492800:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071414.286504:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.286544:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9800, rc 0) 00000100:00100000:0.0:1783071414.286612:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:10244:x1869685665588992:12345-192.168.202.16@tcp:101:bash.0 Request processed in 2487us (6840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071414.286620:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071414.289021:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.289117:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665589120 00000100:00100000:1.0:1783071414.289127:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665589120 00010000:00010000:1.0:1783071414.289166:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071414.289207:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071414.289216:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665589120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071414.289233:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071414.289253:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.289281:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.289307:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec74b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca932 expref: 8 pid: 6585 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.289325:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071414.289329:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071414.289337:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.289347:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.289387:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071414.289402:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1869685684492928:192.168.202.16@tcp:105: 00000100:00100000:1.0:1783071414.289538:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071414.293312:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1869685684492928:192.168.202.16@tcp:105: 00010000:00010000:2.0:1783071414.293340:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071414.293399:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665589120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4182us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071414.293421:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:2.0:1783071414.294838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.294946:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665589376 00000100:00100000:1.0:1783071414.294955:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665589376 00000100:00100000:1.0:1783071414.295011:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1783071414.295022:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:10244:x1869685665589376:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:1.0:1783071414.295395:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10244:x1869685665589376:12345-192.168.202.16@tcp:35:bash.0 Request processed in 374us (564us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783071414.295430:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1783071414.366488:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.371369:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665589632 00000100:00100000:2.0:1783071414.371385:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665589632 00000100:00100000:2.0:1783071414.371482:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1783071414.371493:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10254:x1869685665589632:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071414.371520:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071414.371540:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca940 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071414.371722:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783071414.372203:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca940 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.372218:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071414.372222:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071414.372226:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca940 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.372243:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217d000, rc 0) 00000100:00100000:2.0:1783071414.372316:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10254:x1869685665589632:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 824us (5839us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1783071414.372324:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1783071414.378700:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.379724:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665589888 00000100:00100000:1.0:1783071414.379737:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665589888 00000100:00100000:1.0:1783071414.379790:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1783071414.379809:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10254:x1869685665589888:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071414.380058:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10254:x1869685665589888:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 259us (1396us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783071414.380065:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00010000:00010000:0.0:1783071414.432925:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071414.459239:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.459326:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590016 00000100:00100000:3.0:1783071414.459337:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590016 00000100:00100000:3.0:1783071414.459404:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1783071414.459424:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10260:x1869685665590016:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071414.459454:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.459476:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec74d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca947 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459556:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459570:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459582:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071414.459649:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783071414.459654:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071414.459724:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459752:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec74d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca947 expref: 17 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459772:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca947 expref: 16 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.459779:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071414.459781:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071414.459797:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071414.459852:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:10260:x1869685665590016:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 431us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.459857:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:0.0:1783071414.463345:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.463506:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590272 00000100:00100000:2.0:1783071414.463518:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590272 00000100:00100000:2.0:1783071414.463587:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1783071414.463597:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:10260:x1869685665590272:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071414.463629:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071414.463649:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec74e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca94e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.464059:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec74ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.464075:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec74ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.464100:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec74ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071414.464111:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783071414.464344:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec74e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca94e expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.464367:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec74ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca94e expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.464376:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:2.0:1783071414.464380:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071414.464382:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217ce00, rc 0) 00000100:00100000:2.0:1783071414.464513:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10260:x1869685665590272:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 917us (1179us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783071414.464521:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1783071414.470471:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.470548:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590528 00000100:00100000:3.0:1783071414.470558:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590528 00000100:00100000:3.0:1783071414.471068:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1783071414.471383:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10260:x1869685665590528:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071414.471421:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071414.471445:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec74f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca955 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.471552:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.471568:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.472556:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071414.472587:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783071414.473562:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec74f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca955 expref: 21 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.473598:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca955 expref: 20 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.473617:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:2.0:1783071414.473620:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783071414.473623:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217d000, rc 0) 00000100:00100000:0.0:1783071414.474484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.474593:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590656 00000100:00100000:1.0:1783071414.474609:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590656 00000100:00100000:1.0:1783071414.474670:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1783071414.475074:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10260:x1869685665590528:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3993us (4612us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783071414.475083:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1783071414.477455:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:2358:x1869685665590656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071414.477476:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071414.477505:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec74ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca94e expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.477526:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:1.0:1783071414.477531:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071414.477593:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:2358:x1869685665590656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 160us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071414.482464:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.482554:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590784 00000100:00100000:3.0:1783071414.482576:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590784 00000100:00100000:3.0:1783071414.482649:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1783071414.482658:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665590784:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:3.0:1783071414.482732:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.482752:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.482761:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071414.482765:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071414.482768:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.482821:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.482834:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071414.483087:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684493056:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071414.483177:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb2876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071414.484303:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1783071414.491441:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.491483:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684493056:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071414.491513:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.491622:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665590912 00000100:00100000:0.0:1783071414.491630:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665590912 00002000:00100000:0.0:1783071414.491970:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9782faf2f100 x1869685665590912/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:5/0 lens 504/0 e 0 to 0 dl 1783071425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071414.491982:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faf2f100 with x1869685665590912 ext(0->12) 00010000:00010000:0.0:1783071414.491991:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 8 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.492007:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 8 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071414.492015:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9782faf2f100 00000100:00100000:0.0:1783071414.492047:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1783071414.492057:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665590912:12345-192.168.202.16@tcp:4:lfs.0 00000001:00100000:1.0:1783071414.520101:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000001:00080000:2.0:1783071414.590044:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1783071414.590227:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665590912:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 98166us (98792us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783071414.590239:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:0.0:1783071414.590252:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9782faf2f100 x1869685665590912/t4294967299(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:5/0 lens 504/448 e 0 to 0 dl 1783071425 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071414.590261:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faf2f100 with x1869685665590912 ext(0->12) 00010000:00010000:0.0:1783071414.590271:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.590287:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071414.590295:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9782faf2f100 00000100:00100000:3.0:1783071414.593897:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.594161:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665591040 00000100:00100000:2.0:1783071414.594172:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665591040 00010000:00010000:2.0:1783071414.594214:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071414.594262:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1783071414.594272:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2356:x1869685665591040:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071414.594288:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783071414.594315:0:5777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783071414.594319:0:5777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783071414 00002000:00010000:2.0:1783071414.594321:0:5777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783071415 00002000:00010000:2.0:1783071414.594323:0:5777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783071414 00002000:00010000:2.0:1783071414.594325:0:5777:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1783071414.594332:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.594346:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.594373:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec74c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca939 expref: 7 pid: 6587 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.594391:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071414.594396:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783071414.594401:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.594421:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.594554:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071414.594623:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665591040:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 352us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071414.594631:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00010000:00010000:3.0:1783071414.595908:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.595925:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.595958:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.595967:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.595976:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.595984:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071414.595988:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.596010:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.596026:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.596034:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec750d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071414.596294:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665590784:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 113634us (113838us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.596303:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1783071414.601318:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.601436:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665591296 00000100:00100000:1.0:1783071414.601447:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665591296 00000100:00100000:1.0:1783071414.601507:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1783071414.601512:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1783071414.601518:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:10260:x1869685665591296:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071414.601534:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:1.0:1783071414.601599:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca955 expref: 19 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071414.601921:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1783071414.601977:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1783071414.602544:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1783071414.602599:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.602615:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.602624:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.602657:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.602696:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 23 pid: 5793 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071414.602714:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684493184:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071414.602811:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e3af4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071414.606181:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.606199:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684493184:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071414.606231:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.606290:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665591424 00000100:00100000:0.0:1783071414.606298:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665591424 00010000:00010000:0.0:1783071414.606335:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 24 pid: 5793 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.606386:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1783071414.606395:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:2358:x1869685665591424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071414.606422:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071414.606429:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 24 pid: 5793 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606441:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 24 pid: 5793 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606470:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec74a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca92b expref: 24 pid: 5793 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606485:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:0.0:1783071414.606490:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606499:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606506:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071414.606531:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071414.606552:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.606568:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071414.606590:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:2358:x1869685665591424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 194us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071414.606598:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000001:00080000:1.0:1783071414.606900:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1783071414.607169:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1783071414.607293:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684493312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783071414.607607:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071414.607641:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797d540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071414.607697:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684493312 00000100:00100000:0.0:1783071414.607704:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684493312 00000100:00100000:0.0:1783071414.607755:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071414.607775:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684493312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071414.607852:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684493312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071414.607859:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071414.607888:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684493312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783071414.608643:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1783071414.608760:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684493440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783071414.608798:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071414.608825:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c797d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071414.608856:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684493440 00000100:00100000:0.0:1783071414.608863:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684493440 00000100:00100000:0.0:1783071414.608937:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783071414.608944:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684493440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071414.609180:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869685684493440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 236us (381us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783071414.609188:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071414.609252:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684493440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783071414.609301:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1783071414.609335:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609345:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609354:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609360:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071414.609364:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609395:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609423:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:1.0:1783071414.609427:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783071414.609432:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.609438:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7514 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071414.609619:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783071414.609858:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1783071414.609870:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315984195414ns, next at 316984193564ns, rc = 0 00000001:00080000:1.0:1783071414.609877:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1783071414.609906:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782cc2b6400) 00010000:00010000:1.0:1783071414.609909:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783071414.609916:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec74ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca955 expref: 27 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071414.610019:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:10260:x1869685665591296:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 8502us (8710us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1783071414.610027:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000020:00080000:1.0:1783071414.610030:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783071414.613554:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.613717:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665591552 00000100:00100000:3.0:1783071414.613727:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665591552 00000100:00100000:3.0:1783071414.613775:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1783071414.613793:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:10260:x1869685665591552:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071414.613817:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.613839:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec751b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca95c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.613893:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec751b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca95c expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.613926:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec751b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca95c expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.613946:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071414.613949:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071414.613953:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071414.614010:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:10260:x1869685665591552:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 219us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.614018:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1783071414.617161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.617265:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665591808 00000100:00100000:1.0:1783071414.617274:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665591808 00000100:00100000:1.0:1783071414.617321:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1783071414.617329:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d69d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:10260:x1869685665591808:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071414.617627:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d69d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:10260:x1869685665591808:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 298us (476us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1783071414.617633:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1783071414.674443:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.674580:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665592064 00000100:00100000:3.0:1783071414.674590:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665592064 00000100:00100000:3.0:1783071414.674721:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1783071414.674732:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:10270:x1869685665592064:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071414.674757:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.674777:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca963 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071414.674900:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783071414.675010:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7522 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca963 expref: 30 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.675025:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:3.0:1783071414.675028:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071414.675033:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca963 expref: 30 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.675065:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1a00, rc 0) 00000100:00100000:3.0:1783071414.675115:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10270:x1869685665592064:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 385us (716us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1783071414.675123:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1783071414.677945:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.678030:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665592192 00000100:00100000:3.0:1783071414.678040:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665592192 00000100:00100000:3.0:1783071414.678128:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1783071414.678139:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10270:x1869685665592192:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:3.0:1783071414.678208:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678225:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678238:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678255:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678262:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678268:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678367:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678405:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678422:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071414.678461:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678474:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678481:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678487:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678494:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.678498:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678506:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678518:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071414.678520:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.678525:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678531:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678550:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678556:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678562:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678567:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.678570:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678576:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678583:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9936000) 00010000:00010000:3.0:1783071414.678586:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.678589:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678594:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678619:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678626:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678632:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678642:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.678645:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678651:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678659:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071414.678661:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071414.678664:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.678670:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec753e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071414.678771:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10270:x1869685665592192:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 634us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.678790:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:0.0:1783071414.680939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.681856:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665592448 00000100:00100000:1.0:1783071414.681867:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665592448 00000100:00100000:1.0:1783071414.681918:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1783071414.681927:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10270:x1869685665592448:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071414.682198:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:10270:x1869685665592448:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 271us (1267us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1783071414.682206:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1783071414.714001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.714114:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665592704 00000100:00100000:2.0:1783071414.714123:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665592704 00000100:00100000:2.0:1783071414.714178:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1783071414.714190:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:10273:x1869685665592704:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071414.714215:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071414.714234:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca96a expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714303:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714317:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714327:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714340:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714347:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714353:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714486:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714495:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714516:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071414.714526:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783071414.714619:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714626:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714633:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714639:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071414.714643:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714650:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714660:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071414.714663:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071414.714667:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714707:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec754c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714723:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714728:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714740:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714745:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071414.714748:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714754:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714762:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38400) 00010000:00010000:2.0:1783071414.714764:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071414.714767:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714773:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.714992:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 33 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.715008:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 32 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071414.715014:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071414.715016:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071414.715018:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:3.0:1783071414.716016:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10273:x1869685665592704:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1824us (2020us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1783071414.716025:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1783071414.729169:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.729294:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665592832 00000100:00100000:3.0:1783071414.729303:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665592832 00000100:00100000:3.0:1783071414.729363:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1783071414.729373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10273:x1869685665592832:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071414.729451:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729484:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729495:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729523:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729529:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729535:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729541:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071414.729544:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729552:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729564:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071414.729568:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071414.729573:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.729579:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071414.729643:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10273:x1869685665592832:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 270us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071414.729658:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:0.0:1783071414.738070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071414.738162:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665593088 00000100:00100000:1.0:1783071414.738172:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665593088 00000100:00100000:1.0:1783071414.738249:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1783071414.738259:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10273:x1869685665593088:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071414.738532:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:10273:x1869685665593088:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 273us (472us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1783071414.738539:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071414.962308:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071414.962403:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665593344 00000100:00100000:3.0:1783071414.962424:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665593344 00000100:00100000:3.0:1783071414.962489:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1783071414.962499:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:10304:x1869685665593344:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:3.0:1783071414.962525:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071414.962551:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec756f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca971 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.962664:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.962708:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.962720:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071414.962732:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783071414.962868:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec756f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca971 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.962883:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca971 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071414.962892:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071414.962894:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071414.962898:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1200, rc 0) 00000100:00100000:3.0:1783071414.962972:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10304:x1869685665593344:12345-192.168.202.16@tcp:101:cat.0 Request processed in 475us (677us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1783071414.962980:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1783071414.965270:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071414.966295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071414.966387:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665593728 00000100:00100000:2.0:1783071414.966396:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665593728 00000100:00100000:2.0:1783071414.966462:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:2.0:1783071414.966472:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10304:x1869685665593728:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1783071414.966777:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:10304:x1869685665593728:12345-192.168.202.16@tcp:35:cat.0 Request processed in 306us (486us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783071414.966785:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1783071414.970542:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665593472 00000100:00100000:1.0:1783071414.970558:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665593472 00000100:00100000:1.0:1783071414.970627:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1783071414.970636:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:2357:x1869685665593472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071414.970654:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071414.970694:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca971 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071414.970733:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:1.0:1783071414.970737:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071414.970795:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:2357:x1869685665593472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 159us (5531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071414.970803:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1783071415.012128:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.012314:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665593984 00000100:00100000:3.0:1783071415.012324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665593984 00000100:00100000:3.0:1783071415.012384:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1783071415.012395:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10310:x1869685665593984:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1783071415.012434:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071415.012437:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783071415.012463:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec74dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca947 expref: 35 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012482:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071415.012486:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071415.012499:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7584 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca978 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012588:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012601:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 35 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012610:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012639:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 35 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.012669:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 35 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071415.012727:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684493568:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071415.012810:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071415.015572:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.015713:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594112 00000100:00100000:0.0:1783071415.015722:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594112 00010000:00010000:0.0:1783071415.015758:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 36 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071415.015802:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1783071415.015811:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:2358:x1869685665594112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071415.015825:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071415.015830:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 36 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.015841:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 36 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.015860:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:0.0:1783071415.015866:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.015889:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.015896:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.015912:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071415.015971:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:2358:x1869685665594112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 160us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.015978:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00010000:00010000:3.0:1783071415.017131:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec755a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca96a expref: 35 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071415.017153:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684493568:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071415.017176:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.017185:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.017190:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071415.017208:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783071415.017389:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7584 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.017414:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.017422:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071415.017435:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071415.017439:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0c00, rc 0) 00000100:00100000:3.0:1783071415.017483:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10310:x1869685665593984:12345-192.168.202.16@tcp:101:dd.0 Request processed in 5090us (5364us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783071415.017491:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1783071415.022470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.022554:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594368 00000100:00100000:3.0:1783071415.022564:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594368 00000100:00100000:3.0:1783071415.022628:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1783071415.022638:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10310:x1869685665594368:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:3.0:1783071415.022945:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.022961:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.022972:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071415.023023:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1783071415.023046:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fcaaeca reply state 00000000fefd92ee transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071415.023054:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071415.024304:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:10310:x1869685665594368:12345-192.168.202.16@tcp:36:dd.0 Request processed in 1661us (1836us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783071415.024314:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000020:00080000:2.0:1783071415.024320:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783071415.034352:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034366:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034371:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034389:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071415.034393:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034398:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034421:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071415.034425:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071415.034430:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.034439:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7599 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.236066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.236115:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.236152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.236266:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594496 00000100:00100000:0.0:1783071415.236276:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594496 00000100:00100000:0.0:1783071415.236334:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 275 00000100:00100000:0.0:1783071415.236345:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665594496:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071415.236441:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665594496:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.236450:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 275 00000100:00100000:1.0:1783071415.236743:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594752 00000100:00100000:1.0:1783071415.236749:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594752 00000100:00100000:1.0:1783071415.236803:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:1.0:1783071415.236822:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665594752:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071415.236864:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665594752:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 44us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071415.236871:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00080000:0.0:1783071415.237066:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071415.237764:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594624 00000100:00100000:3.0:1783071415.237770:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594624 00000100:00100000:3.0:1783071415.237978:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1783071415.237990:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665594624:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071415.238048:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665594624:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 61us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071415.239368:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:0.0:1783071415.242440:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.242649:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665594880 00000100:00100000:2.0:1783071415.242658:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665594880 00000100:00100000:2.0:1783071415.242796:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1783071415.242817:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:10324:x1869685665594880:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:2.0:1783071415.242842:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.242859:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec75a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca97f expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242914:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242925:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242947:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242958:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242963:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.242966:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.243046:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.243053:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.243059:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.243086:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.243096:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 38 pid: 5791 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.243106:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684493696:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071415.243183:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071415.247180:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684493696:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071415.247275:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.247487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.247601:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665595136 00000100:00100000:3.0:1783071415.247715:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665595136 00000100:00100000:3.0:1783071415.247787:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1783071415.247797:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:5566:x1869685665595136:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071415.248128:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:5566:x1869685665595136:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 331us (641us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1783071415.248136:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1783071415.250051:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.250125:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665595264 00000100:00100000:1.0:1783071415.250132:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665595264 00010000:00010000:1.0:1783071415.250163:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 40 pid: 5791 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.250193:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:1.0:1783071415.250198:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:2357:x1869685665595264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071415.250210:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071415.250215:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 40 pid: 5791 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250223:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 40 pid: 5791 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250253:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec758b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca978 expref: 40 pid: 5791 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250265:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:1.0:1783071415.250269:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250276:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250281:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.250301:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071415.250332:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250341:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.250353:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:2357:x1869685665595264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 154us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071415.250359:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000004:00200000:3.0:1783071415.250395:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783071415.250399:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071415.250447:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250460:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250470:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250476:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250482:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250488:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071415.250492:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250511:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250521:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071415.250523:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071415.250528:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250534:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec75a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250544:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250549:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250554:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250559:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071415.250562:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250567:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250573:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38400) 00010000:00010000:3.0:1783071415.250575:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071415.250578:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250593:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec75ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250632:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec75a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca97f expref: 39 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250644:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca97f expref: 38 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.250651:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071415.250653:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071415.250655:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938000, rc 0) 00000100:00100000:3.0:1783071415.250728:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:10324:x1869685665594880:12345-192.168.202.16@tcp:101:stat.0 Request processed in 7922us (8359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071415.250735:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1783071415.293031:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.293162:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665595520 00000100:00100000:1.0:1783071415.293172:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665595520 00000100:00100000:1.0:1783071415.293266:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1783071415.293277:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:10330:x1869685665595520:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:1.0:1783071415.293329:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071415.293353:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec75b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca97f expref: 38 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.293367:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:1.0:1783071415.293370:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071415.293597:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.293617:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.293623:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071415.293658:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1783071415.293895:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043d46ebd reply state 00000000be74916e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.293902:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071415.293988:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:10330:x1869685665595520:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 712us (966us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783071415.293995:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000020:00080000:1.0:1783071415.294000:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071415.299009:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299025:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299033:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299039:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.299044:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299052:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299070:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.299073:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.299078:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.299084:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec75bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.384631:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.384800:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665595648 00000100:00100000:0.0:1783071415.384882:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665595648 00000100:00100000:0.0:1783071415.384948:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1783071415.384959:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:10344:x1869685665595648:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:0.0:1783071415.384984:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071415.385003:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec75c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca986 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385090:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385105:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385116:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385129:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385133:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385137:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385225:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385230:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385234:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071415.385262:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783071415.385264:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071415.385281:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385297:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385303:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385307:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385311:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385315:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071415.385319:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385323:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385331:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071415.385333:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071415.385336:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385339:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec75ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385348:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385352:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385359:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385362:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071415.385363:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385367:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385371:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782cc2b6e00) 00010000:00010000:0.0:1783071415.385372:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071415.385382:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385391:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec75d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385434:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec75c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 41 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385447:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.385452:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:0.0:1783071415.385453:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071415.385455:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9800, rc 0) 00000100:00100000:0.0:1783071415.385508:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:10344:x1869685665595648:12345-192.168.202.16@tcp:101:stat.0 Request processed in 552us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.385521:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1783071415.449397:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.449627:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665595904 00000100:00100000:2.0:1783071415.449637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665595904 00000100:00100000:2.0:1783071415.449739:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1783071415.449750:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:10354:x1869685665595904:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071415.449772:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.449813:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec75df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca98d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071415.449913:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783071415.450012:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec75df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca98d expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.450022:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071415.450024:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071415.450028:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec75df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca98d expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.450038:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071415.450124:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:10354:x1869685665595904:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 376us (747us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1783071415.450128:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00010000:00010000:1.0:1783071415.457209:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071415.457271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.457339:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665596160 00000100:00100000:0.0:1783071415.457347:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665596160 00000100:00100000:0.0:1783071415.457446:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071415.457468:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:10354:x1869685665596160:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071415.457772:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+42:10354:x1869685665596160:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 314us (504us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783071415.457780:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071415.512869:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.513215:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665596416 00000100:00100000:3.0:1783071415.513225:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665596416 00000100:00100000:3.0:1783071415.513288:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1783071415.513298:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+42:10360:x1869685665596416:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071415.513323:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071415.513344:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec75ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca994 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.513455:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.513474:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.513497:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.513534:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.513547:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 43 pid: 5793 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071415.513562:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684493824:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071415.513789:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071415.517137:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684493824:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071415.517168:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071415.518604:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.518924:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665596544 00000100:00100000:1.0:1783071415.518933:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665596544 00010000:00010000:1.0:1783071415.518973:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 44 pid: 5793 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.519014:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:1.0:1783071415.519025:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+44:2358:x1869685665596544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071415.519039:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071415.519044:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 44 pid: 5793 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519072:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 44 pid: 5793 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519093:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec75d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca986 expref: 44 pid: 5793 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519110:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:1.0:1783071415.519115:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519124:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519131:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.519163:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071415.519222:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:2358:x1869685665596544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 198us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071415.519230:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00010000:00010000:3.0:1783071415.519422:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.519430:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071415.519448:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1783071415.519592:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec75ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 44 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.519613:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 43 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.519631:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071415.519633:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071415.519636:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071415.519727:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:10360:x1869685665596416:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6378us (6826us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1783071415.519735:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1783071415.523385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.523472:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665596800 00000100:00100000:1.0:1783071415.523482:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665596800 00000100:00100000:1.0:1783071415.523543:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1783071415.523554:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:10360:x1869685665596800:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:1.0:1783071415.523945:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.523961:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.523985:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071415.524039:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1783071415.524063:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006abb8717 reply state 00000000d91d4b53 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071415.524072:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071415.524150:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:10360:x1869685665596800:12345-192.168.202.16@tcp:36:bash.0 Request processed in 597us (777us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783071415.524157:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000020:00080000:1.0:1783071415.524162:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783071415.526080:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526097:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526104:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526110:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071415.526114:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526123:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526137:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:3.0:1783071415.526140:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071415.526144:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.526151:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071415.530179:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.530505:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665596928 00000100:00100000:2.0:1783071415.530516:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665596928 00000100:00100000:2.0:1783071415.530575:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1783071415.530585:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:10360:x1869685665596928:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071415.530619:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.530639:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7609 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca99b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.530745:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.530759:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 46 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.530791:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.530825:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 46 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.530837:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 46 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.530851:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c3e25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684493952:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071415.530935:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071415.534066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.534160:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665597056 00000100:00100000:0.0:1783071415.534169:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665597056 00010000:00010000:0.0:1783071415.534210:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 47 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071415.534250:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:0.0:1783071415.534259:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:2358:x1869685665597056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071415.534276:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071415.534284:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 47 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.534297:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 47 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.534334:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:0.0:1783071415.534338:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.534348:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.534355:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.534387:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071415.534462:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:2358:x1869685665597056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 203us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.534470:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00010000:00010000:2.0:1783071415.535121:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec75f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca994 expref: 46 pid: 6976 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.535138:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c3e25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684493952:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071415.535159:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.535167:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.535174:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071415.535219:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783071415.535223:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071415.535247:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.535287:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7609 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca99b expref: 46 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.535300:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca99b expref: 45 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.535307:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.535310:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071415.535313:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:2.0:1783071415.535350:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:10360:x1869685665596928:12345-192.168.202.16@tcp:101:bash.0 Request processed in 4766us (5181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071415.535357:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:1.0:1783071415.538745:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.538957:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665597312 00000100:00100000:3.0:1783071415.538966:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665597312 00000100:00100000:3.0:1783071415.539023:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1783071415.539035:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d69d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:10360:x1869685665597312:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:3.0:1783071415.539280:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d69d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:10360:x1869685665597312:12345-192.168.202.16@tcp:35:bash.0 Request processed in 247us (545us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1783071415.539288:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071415.608561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.608697:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665597568 00000100:00100000:1.0:1783071415.608707:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665597568 00000100:00100000:1.0:1783071415.608765:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1783071415.608891:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:10370:x1869685665597568:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071415.608917:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071415.608938:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9a2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071415.609062:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783071415.609173:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7617 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9a2 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.609187:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:1.0:1783071415.609190:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071415.609208:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec7617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9a2 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071415.609224:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c13d7c00, rc 0) 00000100:00100000:1.0:1783071415.609293:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10370:x1869685665597568:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 519us (751us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1783071415.609300:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1783071415.616425:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.616998:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665597696 00000100:00100000:3.0:1783071415.617009:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665597696 00000100:00100000:2.0:1783071415.617206:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1783071415.617218:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10370:x1869685665597696:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1783071415.617301:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617318:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617331:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617346:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617352:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617392:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617504:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617512:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617519:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071415.617562:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617574:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617580:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617586:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617604:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.617609:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617616:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617628:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071415.617637:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.617642:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617649:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617663:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617668:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617715:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617720:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.617723:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617728:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617736:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38000) 00010000:00010000:2.0:1783071415.617739:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.617742:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617748:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec762c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617765:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617950:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617955:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617960:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.617964:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617970:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617978:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.617980:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.617983:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.617988:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071415.618071:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10370:x1869685665597696:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 855us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071415.618079:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:1.0:1783071415.619601:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.619666:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665597952 00000100:00100000:3.0:1783071415.619696:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665597952 00000100:00100000:3.0:1783071415.619732:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1783071415.619742:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10370:x1869685665597952:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071415.619962:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+48:10370:x1869685665597952:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 221us (374us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1783071415.619970:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1783071415.647612:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.648297:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665598208 00000100:00100000:2.0:1783071415.648310:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665598208 00000100:00100000:2.0:1783071415.648436:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1783071415.648447:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+48:10373:x1869685665598208:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071415.648472:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.648506:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec763a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9a9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648584:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648610:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648622:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648636:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648642:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648647:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648804:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec764f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648813:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec764f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648820:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec764f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071415.648829:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783071415.648924:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648941:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648948:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648954:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.648958:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648966:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648978:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071415.648982:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.648986:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.648992:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649006:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649012:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649017:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649022:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.649031:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649038:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649046:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38000) 00010000:00010000:2.0:1783071415.649048:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.649051:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649099:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec763a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9a9 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649112:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec764f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9a9 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.649120:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.649122:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071415.649125:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071415.649196:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10373:x1869685665598208:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 751us (1603us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1783071415.649204:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:1.0:1783071415.652943:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071415.652989:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.653080:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665598464 00000100:00100000:2.0:1783071415.653092:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665598464 00000100:00100000:2.0:1783071415.653171:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1783071415.653184:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:2355:x1869685665598464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071415.653219:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071415.653245:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec764f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9a9 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.653266:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.653271:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071415.653335:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:2355:x1869685665598464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071415.653344:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1783071415.653885:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665598336 00000100:00100000:0.0:1783071415.653892:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665598336 00000100:00100000:0.0:1783071415.653934:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1783071415.653942:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10373:x1869685665598336:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1783071415.653999:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654013:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654023:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654060:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654067:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654073:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654079:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071415.654083:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654090:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654100:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:0.0:1783071415.654102:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071415.654105:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.654111:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec765d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071415.654169:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10373:x1869685665598336:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 227us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.654175:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1783071415.657568:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.657734:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665598720 00000100:00100000:2.0:1783071415.657743:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665598720 00000100:00100000:2.0:1783071415.657812:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1783071415.657822:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10373:x1869685665598720:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1783071415.658058:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10373:x1869685665598720:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 236us (499us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1783071415.658066:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1783071415.750668:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.750821:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665598976 00000100:00100000:2.0:1783071415.750831:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665598976 00000100:00100000:2.0:1783071415.750891:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:2.0:1783071415.750901:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10391:x1869685665598976:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1783071415.750924:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.750943:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9b0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.751039:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec766b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.751062:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec766b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.751073:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec766b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071415.751084:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783071415.751351:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b0 expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.751369:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec766b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b0 expref: 52 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.751378:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:2.0:1783071415.751381:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783071415.751384:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938400, rc 0) 00000100:00100000:2.0:1783071415.751457:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10391:x1869685665598976:12345-192.168.202.16@tcp:101:cat.0 Request processed in 557us (799us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1783071415.751465:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1783071415.767568:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.767630:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665599104 00000100:00100000:0.0:1783071415.767641:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665599104 00000100:00100000:0.0:1783071415.767793:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1783071415.767817:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10393:x1869685665599104:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071415.767837:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071415.767853:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9b7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.767902:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.767912:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.767919:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071415.767968:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783071415.767970:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071415.767984:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.768001:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b7 expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.768013:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b7 expref: 53 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.768019:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071415.768021:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071415.768023:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8c00, rc 0) 00000100:00100000:0.0:1783071415.768080:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10393:x1869685665599104:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 264us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.768095:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1783071415.771558:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.771725:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665599488 00000100:00100000:3.0:1783071415.771737:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665599488 00000100:00100000:3.0:1783071415.771811:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1783071415.771822:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10393:x1869685665599488:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071415.772161:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10393:x1869685665599488:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 340us (612us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1783071415.772169:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1783071415.773663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071415.774462:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665599616 00000100:00100000:0.0:1783071415.774472:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665599616 00000100:00100000:0.0:1783071415.774633:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1783071415.774641:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10393:x1869685665599616:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:0.0:1783071415.774654:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783071415.774691:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca99b expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.774707:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec766b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b0 expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.774714:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec751b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca95c expref: 52 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071415.774721:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936800) 00010000:00010000:0.0:1783071415.774959:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071415.775010:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:10393:x1869685665599616:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 370us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071415.775016:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071415.776344:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071415.777026:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665599744 00000100:00100000:3.0:1783071415.777045:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665599744 00000100:00100000:3.0:1783071415.777089:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1783071415.777096:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:10393:x1869685665599744:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:3.0:1783071415.777188:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.777200:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071415.777208:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071415.777474:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071415.777623:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1783071415.777667:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1783071415.777953:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:10393:x1869685665599744:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 855us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071415.777958:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:1.0:1783071415.794712:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071415.795239:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665599872 00000100:00100000:2.0:1783071415.795247:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665599872 00000100:00100000:2.0:1783071415.795299:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:2.0:1783071415.795309:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:10395:x1869685665599872:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071415.795330:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071415.795350:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec768e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9be expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795536:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795547:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795556:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795565:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795570:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795573:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795661:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795666:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795670:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071415.795726:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783071415.795775:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071415.795797:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795819:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795828:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795834:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795838:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795842:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.795845:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795850:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795859:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071415.795860:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.795863:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795867:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795877:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795880:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795888:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795891:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071415.795893:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795896:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795900:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38000) 00010000:00010000:2.0:1783071415.795901:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071415.795903:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795906:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec769c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795928:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec768e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 53 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795936:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 52 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071415.795941:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:2.0:1783071415.795942:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071415.795944:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939a00, rc 0) 00000100:00100000:2.0:1783071415.796174:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10395:x1869685665599872:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 866us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071415.796186:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000040:00080000:3.0:1783071416.443876:0:11851:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071416.443886:0:11851:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071416.443924:0:11851:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783071416.443930:0:11851:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783071416.480841:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783071416.544944:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783071416.544953:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783071416.544997:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783071416.545003:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071416.545132:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684494080:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783071416.546507:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb2873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071416.552881:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.554501:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600000 00000100:00100000:0.0:1783071416.554515:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600000 00000100:00100000:0.0:1783071416.554580:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1783071416.554591:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600000:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783071416.554694:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600000:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 105us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.554712:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00080000:0.0:1783071416.554734:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071416.555215:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bcd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684494080:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783071416.563478:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071416.563649:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600128 00000100:00100000:2.0:1783071416.563658:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600128 00000100:00100000:2.0:1783071416.563938:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1783071416.563951:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10407:x1869685665600128:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071416.563986:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071416.564086:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10407:x1869685665600128:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 138us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.564094:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1783071416.566859:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.567218:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600256 00000100:00100000:1.0:1783071416.567229:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600256 00000100:00100000:1.0:1783071416.567315:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1783071416.567326:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10407:x1869685665600256:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.567421:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567438:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567460:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567477:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567485:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567492:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567519:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567528:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567535:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071416.567573:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783071416.567577:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071416.567604:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567617:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567624:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567641:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567647:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071416.567651:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567659:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567670:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:1.0:1783071416.567691:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071416.567695:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567702:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6c00/0xd360fc6ce6ec76aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567712:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567718:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567724:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567729:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071416.567731:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567747:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567755:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9782cd62c900) 00010000:00010000:1.0:1783071416.567758:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071416.567761:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567835:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7000/0xd360fc6ce6ec76b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567852:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567858:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567864:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567868:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071416.567871:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567877:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567885:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:1.0:1783071416.567888:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071416.567890:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.567905:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d7c00/0xd360fc6ce6ec76b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.567973:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10407:x1869685665600256:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 649us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.567981:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:1.0:1783071416.570148:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.570242:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600512 00000100:00100000:0.0:1783071416.570251:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600512 00000100:00100000:0.0:1783071416.570338:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1783071416.570348:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10407:x1869685665600512:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.570368:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071416.570403:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec76bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9c5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570494:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570507:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570516:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071416.570527:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783071416.570792:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570801:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570807:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570822:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071416.570826:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570833:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570846:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:0.0:1783071416.570848:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071416.570857:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570863:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570902:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec76bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9c5 expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570912:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:0.0:1783071416.570914:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071416.570918:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec76bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9c5 expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.570926:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071416.570974:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600512:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 629us (834us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1783071416.570981:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:1.0:1783071416.573666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.573757:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600640 00000100:00100000:0.0:1783071416.573830:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600640 00000100:00100000:0.0:1783071416.573880:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1783071416.573889:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600640:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783071416.573922:0:6976:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783071416.574016:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600640:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 128us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.574023:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1783071416.590524:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071416.590562:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665600896 00000100:00100000:2.0:1783071416.590572:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665600896 00000100:00100000:0.0:1783071416.590750:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1783071416.590762:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665600896:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.590791:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071416.590795:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783071416.590820:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9b7 expref: 53 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.590836:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071416.590841:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071416.590853:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec76d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9cc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071416.591185:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1783071416.591328:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.591339:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.591346:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.591426:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec76d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9cc expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.591441:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9cc expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.591448:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:0.0:1783071416.591450:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071416.591453:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8000, rc 0) 00000100:00100000:0.0:1783071416.591521:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10407:x1869685665600896:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 761us (1003us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783071416.591528:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:3.0:1783071416.597981:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.598029:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601152 00000100:00100000:0.0:1783071416.598039:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601152 00000100:00100000:0.0:1783071416.598096:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:0.0:1783071416.598106:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10407:x1869685665601152:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.598181:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071416.598203:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec76db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9cc expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598218:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cc2b6e00) 00010000:00010000:0.0:1783071416.598228:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071416.598247:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598257:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598269:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598317:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598322:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598326:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598412:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598417:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598422:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598425:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071416.598429:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598434:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598439:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071416.598441:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071416.598443:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598451:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec76e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598458:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598461:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598465:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598468:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071416.598469:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598472:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598476:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x43175b4f (ffff9782cc2b6600) 00010000:00010000:0.0:1783071416.598477:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071416.598479:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.598482:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec76f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x43175b4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.598547:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665601152:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 442us (573us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071416.598554:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:2.0:1783071416.599821:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.599901:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601280 00000100:00100000:1.0:1783071416.599907:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601280 00000100:00100000:1.0:1783071416.599945:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:1.0:1783071416.599953:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10407:x1869685665601280:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.599971:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071416.599987:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec76f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9d3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600011:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600020:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600025:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600092:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec76f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600111:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.600116:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:1.0:1783071416.600118:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071416.600120:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2600, rc 0) 00000100:00100000:1.0:1783071416.600157:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10407:x1869685665601280:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 206us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.600162:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:2.0:1783071416.601302:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.601442:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601536 00000100:00100000:1.0:1783071416.601449:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601536 00000100:00100000:1.0:1783071416.601493:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:1.0:1783071416.601501:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10407:x1869685665601536:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.601560:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.601574:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.601581:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071416.602101:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1783071416.602108:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317976433865ns, next at 318976432397ns, rc = 0 00000004:00010000:1.0:1783071416.602171:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f32c60fb reply state 0000000060664ece transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.602189:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071416.602284:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c3e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10407:x1869685665601536:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 784us (986us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783071416.602288:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:3.0:1783071416.603443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1783071416.603518:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603528:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603536:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603542:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071416.603546:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603555:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603579:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:2.0:1783071416.603582:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071416.603587:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.603593:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7705 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.603601:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601664 00000100:00100000:0.0:1783071416.603609:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601664 00000100:00100000:0.0:1783071416.603651:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:0.0:1783071416.603659:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10407:x1869685665601664:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.603701:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071416.603715:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.603760:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.603831:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.603845:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:0.0:1783071416.603847:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071416.603848:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071416.603885:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10407:x1869685665601664:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 227us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.603892:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:2.0:1783071416.606003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.606106:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601792 00000100:00100000:0.0:1783071416.606161:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601792 00000100:00100000:0.0:1783071416.606198:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1783071416.606205:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869685665601792:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783071416.606235:0:8704:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1783071416.606259:0:8704:0:(genops.c:1406:class_connect()) connect: client 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a, cookie 0xd360fc6ce6ec7713 00002000:00100000:0.0:1783071416.606269:0:8704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a/ffff9782cd36b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783071416.606298:0:8704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783071416.606526:0:8704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783071416.607012:0:8704:0:(import.c:65:import_set_state_nolock()) ffff9782cd338800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071416.607116:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2354:x1869685665601792:12345-192.168.202.16@tcp:8:lhsmtool_posix.0 Request processed in 909us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.607126:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1783071416.608772:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.608845:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665601920 00000100:00100000:0.0:1783071416.608854:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665601920 00000100:00080000:2.0:1783071416.608897:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071416.608915:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1783071416.608924:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:0:x1869685665601920:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1783071416.625698:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1783071416.625716:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000100:00100000:0.0:1783071416.625936:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:0:x1869685665601920:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 17006us (17163us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783071416.625947:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1783071416.630339:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.630421:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665602176 00000100:00100000:0.0:1783071416.630431:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665602176 00000100:00100000:0.0:1783071416.630491:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1783071416.630501:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10407:x1869685665602176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783071416.630894:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10407:x1869685665602176:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 393us (563us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783071416.630902:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071416.634528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.634573:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665602432 00000100:00100000:0.0:1783071416.634591:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665602432 00000100:00100000:0.0:1783071416.634643:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:0.0:1783071416.634653:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10407:x1869685665602432:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071416.634864:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10407:x1869685665602432:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 211us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.634873:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:3.0:1783071416.637640:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.637702:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665602560 00000100:00100000:1.0:1783071416.637712:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665602560 00000100:00100000:1.0:1783071416.637830:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:1.0:1783071416.637842:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10407:x1869685665602560:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.637863:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071416.637883:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec771a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9e1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638019:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638034:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638047:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071416.638104:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071416.638119:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638140:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec771a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e1 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638154:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e1 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.638161:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:1.0:1783071416.638163:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783071416.638165:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2c00, rc 0) 00000100:00100000:1.0:1783071416.638228:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:10407:x1869685665602560:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 389us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.638234:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:3.0:1783071416.640415:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.640494:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665602688 00000100:00100000:0.0:1783071416.640511:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665602688 00000100:00100000:0.0:1783071416.640598:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1783071416.640607:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665602688:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.640622:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071416.640640:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9e8 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071416.640663:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4782b9, blocks: 0x1 00010000:00010000:0.0:1783071416.640703:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1783071416.640708:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071416.640717:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.640736:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 6 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.640748:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9c00, rc 0) 00000100:00100000:0.0:1783071416.640798:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665602688:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 193us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.640806:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1783071416.642463:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.642510:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665602944 00000100:00100000:1.0:1783071416.642518:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665602944 00000100:00100000:1.0:1783071416.642570:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:1.0:1783071416.642578:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:10407:x1869685665602944:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071416.642671:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:10407:x1869685665602944:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.642707:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:3.0:1783071416.647741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.647854:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603072 00000100:00100000:1.0:1783071416.647864:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603072 00000100:00100000:1.0:1783071416.647922:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1783071416.647948:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:10407:x1869685665603072:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.647968:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071416.647986:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9ef expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.648020:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.648029:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071416.648033:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071416.648038:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.648071:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 7 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.648084:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 7 pid: 6585 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.648098:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684494208:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071416.648204:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1000 going to sleep for 11 seconds 00000100:00100000:3.0:1783071416.654074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.654253:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603200 00000100:00100000:0.0:1783071416.654263:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603200 00010000:00010000:0.0:1783071416.654303:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 8 pid: 6585 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.654332:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684494208:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071416.654345:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:0.0:1783071416.654354:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665603200:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071416.654359:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.654380:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071416.656264:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 8 pid: 6585 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.656285:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 8 pid: 6585 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.656310:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec7728 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e8 expref: 8 pid: 6585 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.656327:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071416.656331:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071416.656338:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.656347:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.656425:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.656442:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684494336:192.168.202.16@tcp:105: 00000100:00100000:0.0:1783071416.656529:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb8549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071416.659530:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684494336:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071416.659554:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071416.659633:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665603200:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5278us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.659643:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00010000:00010000:1.0:1783071416.659791:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2000, rc 0) 00000100:00100000:1.0:1783071416.659821:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:10407:x1869685665603072:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 11877us (12090us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.659827:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1783071416.662847:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.662946:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603328 00000100:00100000:1.0:1783071416.662957:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603328 00002000:00100000:1.0:1783071416.663015:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9782c824dc00 x1869685665603328/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:7/0 lens 504/0 e 0 to 0 dl 1783071427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071416.663028:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782c824dc00 with x1869685665603328 ext(0->8) 00002000:00010000:1.0:1783071416.663033:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782c824dc00 00000100:00100000:1.0:1783071416.663094:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071416.663103:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665603328:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783071416.663635:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665603328:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 531us (797us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783071416.663643:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:1.0:1783071416.663652:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9782c824dc00 x1869685665603328/t4294967302(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:7/0 lens 504/448 e 0 to 0 dl 1783071427 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071416.663660:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782c824dc00 with x1869685665603328 ext(0->8) 00002000:00010000:1.0:1783071416.663664:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782c824dc00 00000100:00100000:3.0:1783071416.665561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071416.665711:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603456 00000100:00100000:2.0:1783071416.665721:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603456 00000100:00100000:2.0:1783071416.665910:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1783071416.665921:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:10407:x1869685665603456:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783071416.698487:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1783071416.698515:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1783071416.698547:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1783071416.698574:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782c797d540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1783071416.698579:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782cc014800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782c797d6c0 00000020:00080000:0.0:1783071416.698582:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782cc014f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9781c49e5400 00000100:00100000:2.0:1783071416.698613:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:10407:x1869685665603456:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 32689us (33054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.698623:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000020:00080000:0.0:1783071416.698700:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1783071416.698813:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783071416.698828:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c85d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684494464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783071416.698880:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071416.698978:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071416.698986:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684494592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783071416.699013:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071416.699042:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684494464 00000100:00100000:1.0:1783071416.699055:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684494464 00000100:00100000:1.0:1783071416.699104:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684494592 00000100:00100000:1.0:1783071416.699107:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684494592 00000100:00100000:1.0:1783071416.699132:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071416.699141:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1869685684494464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783071416.699165:0:6585:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1783071416.699195:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a4782b6, atime: 0x6a4782b7, ctime: 0x6a4782b6, blocks: 0xb 00010000:00010000:1.0:1783071416.699203:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.699220:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1783071416.699224:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071416.699229:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.699241:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.699249:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.699254:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.699270:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071416.699296:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071416.699303:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.699312:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071416.699317:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.699325:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.699341:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.699359:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e412eb/0xd360fc6ce6ec7736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.699376:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071416.699378:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071416.699380:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071416.699728:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1869685684494464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 586us (846us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783071416.699735:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783071416.699744:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684494592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783071416.699850:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783071416.699854:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783071417 00002000:00010000:0.0:1783071416.699856:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783071416.699858:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783071417 -> 1783071417 00002000:00010000:0.0:1783071416.699861:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783071416.699889:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1869685684494592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (874us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783071416.701166:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783071416.701183:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783071416.701212:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071416.701217:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783071416.701246:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782facb7100/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783071416.701253:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684494592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1783071416.701266:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782c85d1c00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783071416.701270:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c85d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684494464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783071416.702093:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071416.702158:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603584 00000100:00100000:3.0:1783071416.702166:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603584 00000100:00100000:3.0:1783071416.702213:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1783071416.702221:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665603584:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783071416.719107:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665603584:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 16874us (17006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.719122:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000001:00080000:1.0:1783071416.719430:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1783071416.719445:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1783071416.722870:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.722956:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603840 00000100:00100000:1.0:1783071416.722965:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603840 00000100:00100000:1.0:1783071416.723048:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:1.0:1783071416.723057:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10407:x1869685665603840:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.723106:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071416.723127:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9e1 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.723141:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:1.0:1783071416.723144:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071416.723169:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.723183:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.723192:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071416.723418:0:6976:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f8b82df reply state 00000000e9a1940f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.723428:0:6976:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071416.723555:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10407:x1869685665603840:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 488us (685us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783071416.723564:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00010000:00010000:3.0:1783071416.725180:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725195:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725202:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725208:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071416.725213:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725219:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725235:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:3.0:1783071416.725249:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071416.725254:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.725261:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec773d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071416.726417:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.726611:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665603968 00000100:00100000:1.0:1783071416.726621:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665603968 00000100:00100000:1.0:1783071416.726745:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1783071416.726755:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665603968:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783071416.726997:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783071416.727000:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783071417 -> 1783071416 00002000:00010000:1.0:1783071416.727002:0:6585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783071415 00002000:00010000:1.0:1783071416.727004:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783071417 -> 1783071416 00002000:00010000:1.0:1783071416.727005:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783071416.727065:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665603968:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 312us (654us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783071416.727072:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1783071416.728702:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.728960:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604224 00000100:00100000:1.0:1783071416.728969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604224 00000100:00100000:1.0:1783071416.729026:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:1.0:1783071416.729046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10407:x1869685665604224:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783071416.729107:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.729121:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.729127:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.729169:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.729182:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 13 pid: 5792 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.729197:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684494720:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071416.729285:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071416.730897:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684494720:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071416.730927:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071416.731977:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.732022:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604352 00000100:00100000:0.0:1783071416.732030:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604352 00010000:00010000:0.0:1783071416.732077:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 14 pid: 5792 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.732133:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071416.732143:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2358:x1869685665604352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071416.732158:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071416.732165:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 14 pid: 5792 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732176:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 14 pid: 5792 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732198:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec76fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9d3 expref: 14 pid: 5792 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732213:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:0.0:1783071416.732218:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732227:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732235:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.732267:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071416.732319:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2358:x1869685665604352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 177us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.732326:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00010000:00010000:1.0:1783071416.732699:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732709:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732738:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732745:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732752:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732758:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071416.732763:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732779:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732789:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:1.0:1783071416.732792:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783071416.732796:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.732801:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7744 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.732858:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:10407:x1869685665604224:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 3823us (4162us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783071416.732867:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:2.0:1783071416.734423:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.734584:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604480 00000100:00100000:0.0:1783071416.734604:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604480 00000100:00100000:0.0:1783071416.734730:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1783071416.734746:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665604480:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.734787:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.734803:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.734809:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071416.734812:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071416.734815:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.734839:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.734849:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.734859:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6587:1869685684494848:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071416.734919:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4e4fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783071416.736932:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071416.736976:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604608 00000100:00100000:1.0:1783071416.736984:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604608 00010000:00010000:1.0:1783071416.737020:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 8 pid: 6588 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071416.737201:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1783071416.737211:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665604608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071416.737225:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071416.737246:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 8 pid: 6588 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.737260:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 8 pid: 6588 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.737302:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071416.737306:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071416.737312:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.737321:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071416.737338:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071416.737401:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665604608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 181us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071416.737409:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00010000:00010000:0.0:1783071416.740864:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec772f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9ef expref: 7 pid: 6588 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.740890:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6587:1869685684494848:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071416.740945:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.740956:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.740963:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.740999:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741008:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741016:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741023:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071416.741027:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741035:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741052:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.741067:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000858b9fca/0xd360fc6ce6ec774b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.741174:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665604480:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 6435us (6761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071416.741184:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:3.0:1783071416.743760:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071416.743863:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604864 00000100:00100000:0.0:1783071416.743872:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604864 00000100:00100000:0.0:1783071416.743929:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:0.0:1783071416.743939:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:10407:x1869685665604864:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783071416.744016:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744032:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744042:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744366:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744375:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744381:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744557:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.744573:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 13 pid: 5791 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.744588:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684494976:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071416.744743:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4e4fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071416.747988:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071416.748073:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665604992 00000100:00100000:2.0:1783071416.748082:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665604992 00010000:00010000:2.0:1783071416.748133:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 14 pid: 5791 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071416.748180:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:2.0:1783071416.748190:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2358:x1869685665604992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071416.748204:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071416.748211:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 14 pid: 5791 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.748225:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 14 pid: 5791 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.748249:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:2.0:1783071416.748254:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.748264:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.748272:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.748291:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071416.748429:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2358:x1869685665604992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 239us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.748438:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00010000:00010000:0.0:1783071416.749094:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec770c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9da expref: 13 pid: 5791 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.749115:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684494976:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071416.749143:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.749164:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.749172:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071416.749366:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1783071416.749657:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1783071416.749859:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1783071416.749945:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1869685684495104:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783071416.749996:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071416.750021:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2945480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071416.750191:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684495104 00000100:00100000:2.0:1783071416.750198:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684495104 00000100:00100000:2.0:1783071416.750246:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071416.750260:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5793:x1869685684495104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783071416.750336:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5793:x1869685684495104:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071416.750343:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071416.750375:0:5793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783071416.750380:0:5793:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782facb7100, transno 4294967303 00000100:00100000:2.0:1783071416.750401:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1869685684495104:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783071416.751412:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783071416.751668:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1869685684495232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783071416.751746:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071416.751942:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684495232 00000100:00100000:1.0:1783071416.751949:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684495232 00000100:00100000:1.0:1783071416.751993:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071416.752000:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5793:x1869685684495232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783071416.753216:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1869685684495232:12345-0@lo:1000:mdt00_002.0 Request processed in 1212us (1465us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783071416.753229:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071416.753985:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5540 going to sleep for 11 seconds 00000100:00100000:2.0:1783071416.754027:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5793:1869685684495232:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783071416.754074:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754084:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754092:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754098:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071416.754103:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754110:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754124:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782cd62c900) 00010000:00010000:2.0:1783071416.754140:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071416.754145:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754152:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7759 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754206:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754213:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754218:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754222:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071416.754225:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754230:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754238:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:2.0:1783071416.754240:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071416.754243:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754248:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7687 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754268:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754290:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 16 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754299:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754333:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 16 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.754348:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 16 pid: 6976 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071416.754362:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684495360:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071416.754572:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071416.758500:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684495360:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071416.758544:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071416.759099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071416.759279:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665605120 00000100:00100000:3.0:1783071416.759287:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665605120 00010000:00010000:3.0:1783071416.759327:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 17 pid: 6976 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071416.759367:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1783071416.759377:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:2358:x1869685665605120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071416.759402:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071416.759409:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 17 pid: 6976 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759421:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 17 pid: 6976 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759505:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec76a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9be expref: 17 pid: 6976 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759522:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:3.0:1783071416.759527:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759548:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759555:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071416.759725:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071416.759780:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:2358:x1869685665605120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 404us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071416.759789:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00010000:00010000:0.0:1783071416.760352:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760361:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760374:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760379:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760386:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760401:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071416.760406:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760414:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760426:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:0.0:1783071416.760428:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071416.760432:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760438:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7760 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760528:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760534:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760540:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760545:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071416.760548:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760553:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760560:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936000) 00010000:00010000:0.0:1783071416.760563:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071416.760566:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.760571:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7752 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071416.761170:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10407:x1869685665604864:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 17221us (17407us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1783071416.761181:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000020:00080000:0.0:1783071416.761186:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783071416.762217:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071416.762224:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071416.762281:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783071416.762288:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071416.769220:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071416.769343:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665605376 00000100:00100000:2.0:1783071416.769352:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665605376 00000100:00100000:2.0:1783071416.769459:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1783071416.769468:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10407:x1869685665605376:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783071416.770060:0:11813:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783071416.770150:0:11813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1783071416.770193:0:11813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770206:0:11813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770215:0:11813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770226:0:11813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770231:0:11813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770235:0:11813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071416.770246:0:11813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783071416.770323:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:10407:x1869685665605376:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 856us (1109us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783071416.770328:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000020:00080000:2.0:1783071416.770332:0:11813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783071416.770633:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071416.770638:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.770644:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071416.770647:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.770653:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.770663:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9782d9b38000) 00010000:00010000:0.0:1783071416.770665:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783071416.770669:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.770697:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7767 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071416.770714:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071416.770715:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071416.770717:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071417.505366:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071418.265309:0:11904:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071418.265319:0:11904:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071418.265354:0:11904:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783071418.265360:0:11904:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071418.391569:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.391778:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665605632 00000100:00100000:3.0:1783071418.391787:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665605632 00000100:00100000:3.0:1783071418.391969:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:3.0:1783071418.391981:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:10424:x1869685665605632:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071418.392005:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071418.392024:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec776e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.392289:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0800/0xd360fc6ce6ec7775 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.392303:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0800/0xd360fc6ce6ec7775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.392315:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0800/0xd360fc6ce6ec7775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071418.392327:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783071418.392514:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec776e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9f6 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.392538:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0800/0xd360fc6ce6ec7775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9f6 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.392547:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071418.392550:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071418.392554:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0800, rc 0) 00000100:00100000:3.0:1783071418.393815:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:10424:x1869685665605632:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1828us (2246us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783071418.393827:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00080000:0.0:1783071418.398538:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071418.398635:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.398773:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665605760 00000100:00100000:2.0:1783071418.398785:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665605760 00000100:00100000:2.0:1783071418.398916:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:2.0:1783071418.398928:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:10424:x1869685665605760:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1783071418.399006:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399023:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399035:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399049:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399077:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399084:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399388:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399397:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399405:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071418.399448:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399460:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399467:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399473:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399480:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.399484:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399492:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399512:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071418.399515:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.399521:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399527:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399539:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399545:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399551:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399555:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.399558:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399564:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399572:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38900) 00010000:00010000:2.0:1783071418.399574:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.399577:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399582:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec778a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399608:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399614:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399620:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399625:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.399627:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399633:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399640:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9b38b00) 00010000:00010000:2.0:1783071418.399642:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.399644:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.399649:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.399751:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:10424:x1869685665605760:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 824us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071418.399760:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1783071418.436970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.437020:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665606016 00000100:00100000:3.0:1783071418.437031:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665606016 00000100:00100000:3.0:1783071418.437094:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1783071418.437104:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:10427:x1869685665606016:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071418.437126:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071418.437145:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bca9fd expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437217:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437231:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437313:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437330:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437344:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.437350:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438066:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438077:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438085:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071418.438096:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783071418.438193:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438201:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438207:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438213:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071418.438218:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438225:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438308:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071418.438311:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071418.438316:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438323:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec779f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438333:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438340:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438346:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438352:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071418.438355:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438361:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438370:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9936400) 00010000:00010000:3.0:1783071418.438372:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071418.438628:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438637:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec77a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438715:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438731:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.438738:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.438741:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071418.438744:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071418.438890:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10427:x1869685665606016:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1785us (1927us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783071418.438900:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:3.0:1783071418.445371:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.445421:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665606144 00000100:00100000:3.0:1783071418.445431:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665606144 00000100:00100000:3.0:1783071418.445481:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1783071418.445492:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10427:x1869685665606144:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071418.445555:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445571:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445596:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445620:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445634:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445640:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445645:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071418.445649:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445657:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445949:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.445952:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071418.445957:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.445962:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.446031:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10427:x1869685665606144:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 540us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.446038:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:2.0:1783071418.451014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.451072:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665606400 00000100:00100000:3.0:1783071418.451084:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665606400 00000100:00100000:3.0:1783071418.451143:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1783071418.451154:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10427:x1869685665606400:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071418.451480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:10427:x1869685665606400:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 327us (476us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1783071418.451498:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1783071418.488667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.488820:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665606656 00000100:00100000:2.0:1783071418.488830:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665606656 00000100:00100000:2.0:1783071418.488982:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:2.0:1783071418.488994:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:9949:x1869685665606656:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071418.489019:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071418.489041:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec77c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa04 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.489157:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.489171:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.489180:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.489214:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.489227:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 23 pid: 5792 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.489241:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684495488:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071418.490045:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e285c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071418.496026:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9bf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684495488:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071418.496060:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071418.497142:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.497209:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665606784 00000100:00100000:2.0:1783071418.497217:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665606784 00010000:00010000:2.0:1783071418.497259:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 24 pid: 5792 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.497304:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1783071418.497332:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:2357:x1869685665606784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071418.497350:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071418.497357:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 24 pid: 5792 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497371:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 24 pid: 5792 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497407:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec77ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9fd expref: 24 pid: 5792 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497423:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071418.497429:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497440:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497448:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.497479:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071418.497539:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:2357:x1869685665606784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 209us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071418.497547:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00010000:00010000:3.0:1783071418.497770:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.497780:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071418.497802:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783071418.497954:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec77c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.497972:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.497979:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.497983:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071418.497985:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:3.0:1783071418.498026:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:9949:x1869685665606656:12345-192.168.202.16@tcp:101:bash.0 Request processed in 9035us (9369us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783071418.498035:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:1.0:1783071418.501485:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.501668:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607040 00000100:00100000:3.0:1783071418.501699:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607040 00000100:00100000:3.0:1783071418.501751:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1783071418.501781:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:9949:x1869685665607040:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1783071418.502039:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.502059:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.502068:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071418.502164:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1783071418.502184:0:6976:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041d3ee72 reply state 0000000074462425 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.502191:0:6976:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783071418.502222:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1783071418.502304:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:9949:x1869685665607040:12345-192.168.202.16@tcp:36:bash.0 Request processed in 527us (829us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1783071418.502310:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000020:00080000:3.0:1783071418.502314:0:6976:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783071418.505297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.505433:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607168 00000100:00100000:3.0:1783071418.505443:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607168 00000100:00100000:3.0:1783071418.505508:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:3.0:1783071418.505519:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:9949:x1869685665607168:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071418.505545:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071418.505565:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec77de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa0b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.505625:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec77de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa0b expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.505653:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec77de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa0b expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.505693:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.505695:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071418.505700:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1a00, rc 0) 00000100:00100000:3.0:1783071418.505757:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:9949:x1869685665607168:12345-192.168.202.16@tcp:101:bash.0 Request processed in 239us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.505763:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00010000:00010000:0.0:1783071418.505937:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.505953:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.505962:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.505968:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.505973:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.505981:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.505993:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071418.505996:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071418.506000:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.506006:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec77d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.508315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.508451:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607296 00000100:00100000:1.0:1783071418.508461:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607296 00000100:00100000:1.0:1783071418.508532:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071418.508544:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:9949:x1869685665607296:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071418.508559:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1783071418.508622:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783071418.508707:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa12 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071418.508732:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4782b8, atime: 0x6a4782b7, ctime: 0x6a4782b8, blocks: 0xb 00010000:00010000:1.0:1783071418.508837:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1783071418.508843:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071418.508851:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.508871:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.508883:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2e00, rc 0) 00000100:00100000:1.0:1783071418.508990:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:9949:x1869685665607296:12345-192.168.202.16@tcp:101:bash.0 Request processed in 448us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.508998:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071418.511805:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.512023:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607424 00000100:00100000:0.0:1783071418.512034:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607424 00002000:00010000:0.0:1783071418.512074:0:6591:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783071418.512079:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782facb7100 with x1869685665607424 ext(0->18446744073709551615) 00002000:00010000:0.0:1783071418.512091:0:6591:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782facb7100. 00000100:00100000:0.0:1783071418.512155:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1783071418.512166:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2355:x1869685665607424:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:0.0:1783071418.512464:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783071418.512468:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783071416 -> 1783071419 00002000:00010000:0.0:1783071418.512470:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783071415 -> 1783071415 00002000:00010000:0.0:1783071418.512472:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783071416 -> 1783071419 00002000:00010000:0.0:1783071418.512474:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783071418.512542:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2355:x1869685665607424:12345-192.168.202.16@tcp:10:bash.0 Request processed in 378us (745us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783071418.512551:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00010000:0.0:1783071418.512554:0:6591:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783071418.512557:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782facb7100 with x1869685665607424 ext(0->18446744073709551615) 00002000:00010000:0.0:1783071418.512562:0:6591:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782facb7100. 00010000:00010000:0.0:1783071418.528938:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071418.578816:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.579975:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607552 00000100:00100000:0.0:1783071418.579987:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607552 00000100:00100000:0.0:1783071418.580058:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1783071418.580071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:10441:x1869685665607552:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1783071418.580141:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580158:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580169:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580184:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580209:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580217:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580524:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580534:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.580541:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071418.583025:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583046:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583052:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583059:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583065:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.583069:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583076:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583108:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071418.583111:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071418.583115:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583120:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec77ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583136:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583141:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583146:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583150:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.583152:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583157:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583162:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782cc2b6600) 00010000:00010000:0.0:1783071418.583164:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071418.583166:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583172:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec77f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583198:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583204:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583209:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583214:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.583218:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583223:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583232:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071418.583234:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071418.583237:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.583242:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec77fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071418.583332:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:10441:x1869685665607552:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 3260us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071418.583344:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:2.0:1783071418.598997:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071418.599024:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782facb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684495616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071418.599104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071418.599296:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684495616 00000100:00100000:1.0:1783071418.599304:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684495616 00000100:00080000:0.0:1783071418.599429:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071418.599470:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071418.599483:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684495616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071418.599528:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071418.599593:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684495616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.599600:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783071418.599708:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782facb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684495616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071418.612150:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.612692:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607808 00000100:00100000:2.0:1783071418.612704:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607808 00000100:00100000:2.0:1783071418.612761:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:2.0:1783071418.612771:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:10444:x1869685665607808:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071418.612793:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071418.612815:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa19 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.612993:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613008:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613020:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613033:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613040:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613046:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613391:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613401:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613423:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071418.613435:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783071418.613530:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613538:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.613544:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614201:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.614207:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614216:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614231:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071418.614234:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.614240:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614247:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7808 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614261:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614267:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614281:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614286:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.614289:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614295:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614303:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38b00) 00010000:00010000:2.0:1783071418.614306:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.614309:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.614314:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec780f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.614884:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa19 expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.614907:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa19 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.614914:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.614917:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071418.614920:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:3.0:1783071418.615003:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10444:x1869685665607808:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2232us (2871us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1783071418.615012:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:1.0:1783071418.618480:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.618659:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665607936 00000100:00100000:3.0:1783071418.618670:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665607936 00000100:00100000:3.0:1783071418.618771:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:3.0:1783071418.618798:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10444:x1869685665607936:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071418.618869:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.618884:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.618893:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.618925:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.618939:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 29 pid: 5791 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.618953:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c85d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684495744:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071418.619045:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071418.624058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.624424:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665608192 00000100:00100000:2.0:1783071418.624435:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665608192 00000100:00100000:2.0:1783071418.624503:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071418.624513:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:6028:x1869685665608192:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783071418.624903:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:6028:x1869685665608192:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 389us (854us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783071418.624911:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1783071418.625243:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c85d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684495744:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071418.625269:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.628558:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.629559:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665608320 00000100:00100000:3.0:1783071418.629578:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665608320 00010000:00010000:3.0:1783071418.629629:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 31 pid: 5791 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.629691:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1783071418.629718:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:2358:x1869685665608320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071418.629737:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071418.629744:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 31 pid: 5791 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.629770:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 31 pid: 5791 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.629794:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec77c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa04 expref: 31 pid: 5791 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.629811:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.629816:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.629826:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.629833:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.630117:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071418.630183:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:2358:x1869685665608320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 466us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.630191:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00010000:00010000:0.0:1783071418.630955:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.630977:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631019:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631026:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631033:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631038:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.631043:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631051:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631065:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071418.631067:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071418.631070:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.631075:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071418.631179:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10444:x1869685665607936:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 12381us (12709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071418.631188:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1783071418.645387:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.645454:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665608576 00000100:00100000:3.0:1783071418.645466:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665608576 00000100:00100000:3.0:1783071418.645714:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1783071418.645726:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:10444:x1869685665608576:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071418.646216:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:10444:x1869685665608576:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 491us (848us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1783071418.646225:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1783071418.731204:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.735334:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665608832 00000100:00100000:1.0:1783071418.735350:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665608832 00000100:00100000:1.0:1783071418.735437:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:1.0:1783071418.735449:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:10455:x1869685665608832:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1783071418.735476:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071418.735497:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec782b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa20 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735584:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735597:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735608:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735623:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735631:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.735637:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736137:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736148:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736154:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071418.736165:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783071418.736252:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736259:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736266:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736273:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071418.736277:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736284:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736295:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:1.0:1783071418.736298:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071418.736302:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736318:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736330:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736336:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736342:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736347:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071418.736350:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736355:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736364:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782c4fab000) 00010000:00010000:1.0:1783071418.736366:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071418.736369:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736384:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736427:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec782b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa20 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736439:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa20 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.736451:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071418.736453:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071418.736456:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071418.736745:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10455:x1869685665608832:12345-192.168.202.16@tcp:101:cat.0 Request processed in 1297us (5549us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783071418.736753:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:1.0:1783071418.741481:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.741573:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609088 00000100:00100000:0.0:1783071418.741583:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609088 00000100:00100000:0.0:1783071418.741644:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1783071418.741654:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10455:x1869685665609088:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:0.0:1783071418.742128:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:10455:x1869685665609088:12345-192.168.202.16@tcp:35:cat.0 Request processed in 474us (654us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783071418.742137:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1783071418.756454:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.756595:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609344 00000100:00100000:3.0:1783071418.756605:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609344 00000100:00100000:3.0:1783071418.756663:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:3.0:1783071418.756715:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:10456:x1869685665609344:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:3.0:1783071418.756796:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783071418.756820:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa20 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756836:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa19 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756844:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec77de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa0b expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756851:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071418.756857:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071418.756875:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756887:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756896:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756922:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756931:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.756937:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.757181:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.757187:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.757191:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071418.757953:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1783071418.757965:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320132290198ns, next at 321132287616ns, rc = 0 00010000:00010000:3.0:1783071418.758022:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758037:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758044:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758052:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758068:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758074:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758142:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783071418.758163:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758169:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758176:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758181:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071418.758186:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758193:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758205:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936100) 00010000:00010000:3.0:1783071418.758208:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783071418.758211:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758216:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec785c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758229:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758238:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758242:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758244:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071418.758246:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758250:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758255:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071418.758257:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071418.758258:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.758261:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec784e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071418.758267:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c73f595c reply state 000000009ceba829 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.758273:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071418.758405:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:10456:x1869685665609344:12345-192.168.202.16@tcp:36:rm.0 Request processed in 1730us (1960us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1783071418.758411:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00010000:00010000:1.0:1783071418.758426:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071418.758436:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.758444:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071418.758447:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.758455:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.758465:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9782d9936100) 00010000:00010000:1.0:1783071418.758468:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071418.758471:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.758476:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.758492:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071418.758494:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071418.758495:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071418.760889:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760905:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760912:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760918:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071418.760923:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760931:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760945:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9936400) 00010000:00010000:0.0:1783071418.760948:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071418.760952:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.760959:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.801366:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.801571:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609600 00000100:00100000:1.0:1783071418.801582:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609600 00000100:00100000:1.0:1783071418.801646:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:1.0:1783071418.801657:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:10462:x1869685665609600:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071418.801723:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071418.801746:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec786a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa27 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801895:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801911:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801923:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801939:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801947:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.801953:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071418.802549:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1783071418.802747:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802758:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802775:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802815:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802823:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802829:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802836:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071418.802841:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802849:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802861:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:1.0:1783071418.802864:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071418.802869:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802876:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7871 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071418.802889:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e24c6ca7 reply state 000000001224c0c7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071418.802897:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783071418.802935:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec786a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802949:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.802956:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071418.802959:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071418.802961:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3400, rc 0) 00000100:00100000:1.0:1783071418.803040:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:10462:x1869685665609600:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1385us (1684us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1783071418.803049:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00010000:00010000:2.0:1783071418.806316:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806336:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806344:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806350:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071418.806356:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806364:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806393:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782c4fab000) 00010000:00010000:2.0:1783071418.806397:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071418.806401:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.806407:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7878 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.808126:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.808180:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609728 00000100:00100000:3.0:1783071418.808190:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609728 00000100:00100000:3.0:1783071418.808326:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1783071418.808336:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665609728:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071418.808355:0:8704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071418.808387:0:8704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa2e expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071418.808414:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071418.808434:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1783071418.808439:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071418.808449:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 6 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.808466:0:8704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 6 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.808479:0:8704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071418.808547:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665609728:12345-192.168.202.16@tcp:101:bash.0 Request processed in 200us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.808553:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00080000:2.0:1783071418.810057:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071418.811526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.813362:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609856 00000100:00100000:2.0:1783071418.813387:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609856 00000100:00100000:2.0:1783071418.813458:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:2.0:1783071418.813468:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:10462:x1869685665609856:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071418.813507:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071418.813529:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa35 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.813566:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.813576:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071418.813581:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071418.813587:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.813624:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.813637:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.813655:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa979500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684495872:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071418.813791:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071418.816904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071418.817171:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa979500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684495872:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071418.817205:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071418.817227:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938e00, rc 0) 00000100:00100000:2.0:1783071418.817309:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:10462:x1869685665609856:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3842us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071418.817318:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071418.817349:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665609984 00000100:00100000:1.0:1783071418.817357:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665609984 00010000:00010000:1.0:1783071418.817408:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071418.817443:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1783071418.817452:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665609984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071418.817473:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071418.817496:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.817510:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.817534:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000afdaa2c/0xd360fc6ce6ec788d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa2e expref: 7 pid: 8704 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.817556:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071418.817560:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071418.818002:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.818014:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.818050:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071418.818064:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1869685684496000:192.168.202.16@tcp:105: 00000100:00100000:1.0:1783071418.818119:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071418.822114:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1869685684496000:192.168.202.16@tcp:105: 00010000:00010000:1.0:1783071418.822142:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071418.822199:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665609984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4747us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.822210:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1783071418.825296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.825407:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665610240 00000100:00100000:0.0:1783071418.825419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665610240 00000100:00100000:0.0:1783071418.825477:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1783071418.825487:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:10462:x1869685665610240:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1783071418.826168:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:10462:x1869685665610240:12345-192.168.202.16@tcp:35:bash.0 Request processed in 679us (877us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783071418.826177:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1783071418.968099:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.968216:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665610368 00000100:00100000:0.0:1783071418.968229:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665610368 00000100:00100000:0.0:1783071418.968294:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:0.0:1783071418.968314:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:10478:x1869685665610368:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071418.968349:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071418.968385:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec789b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa3c expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968457:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968470:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968480:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071418.968541:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783071418.968545:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071418.968564:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968819:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec789b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa3c expref: 36 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968836:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa3c expref: 35 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.968844:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071418.968847:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071418.968850:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8c00, rc 0) 00000100:00100000:0.0:1783071418.968921:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10478:x1869685665610368:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 619us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071418.968928:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:3.0:1783071418.973903:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071418.974027:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665610624 00000100:00100000:0.0:1783071418.974037:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665610624 00000100:00100000:0.0:1783071418.974091:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:0.0:1783071418.974099:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:10478:x1869685665610624:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071418.974119:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071418.974137:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa43 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.974231:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec78b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.974244:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec78b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.974255:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec78b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071418.974278:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783071418.974484:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa43 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.974499:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec78b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa43 expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071418.974505:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071418.974507:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071418.974509:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071418.974592:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:10478:x1869685665610624:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 493us (701us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783071418.974598:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:1.0:1783071418.978267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.978351:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665610752 00000100:00100000:3.0:1783071418.978358:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665610752 00000100:00100000:3.0:1783071418.979107:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1783071418.979134:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:2356:x1869685665610752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071418.979150:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071418.979171:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec78b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa43 expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.979185:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:3.0:1783071418.979188:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071418.979232:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:2356:x1869685665610752:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 104us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.979237:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1783071418.979483:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.979889:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611008 00000100:00100000:1.0:1783071418.979897:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611008 00000100:00100000:1.0:1783071418.979942:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:1.0:1783071418.979950:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:10478:x1869685665611008:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071418.979969:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071418.979992:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec78be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa4a expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.980087:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.980101:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.980111:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071418.980122:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783071418.980242:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec78be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa4a expref: 39 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.980256:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa4a expref: 38 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.980263:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071418.980266:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783071418.980268:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2400, rc 0) 00000100:00100000:1.0:1783071418.980309:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:10478:x1869685665611008:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 361us (828us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1783071418.980314:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:2.0:1783071418.987816:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071418.987956:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611136 00000100:00100000:3.0:1783071418.987966:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611136 00000100:00100000:3.0:1783071418.988023:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1783071418.988030:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665611136:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:3.0:1783071418.988074:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.988091:0:8704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.988097:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071418.988100:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071418.988103:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.988129:0:8704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.988154:0:8704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 6 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.988165:0:8704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c85d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8704:1869685684496128:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071418.988240:0:8704:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb8546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071418.990168:0:8704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c85d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8704:1869685684496128:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071418.990200:0:8704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071418.991476:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.991761:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611264 00000100:00100000:1.0:1783071418.991770:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611264 00002000:00100000:1.0:1783071418.991821:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9782faa0f480 x1869685665611264/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:9/0 lens 504/0 e 0 to 0 dl 1783071429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071418.991832:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faa0f480 with x1869685665611264 ext(0->8) 00010000:00010000:1.0:1783071418.991851:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 7 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.991866:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 7 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071418.991874:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9782faa0f480 00000100:00100000:1.0:1783071418.991905:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1783071418.991914:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665611264:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:1.0:1783071418.992468:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665611264:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 553us (996us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783071418.992477:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00002000:00100000:1.0:1783071418.992484:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9782faa0f480 x1869685665611264/t4294967302(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:9/0 lens 504/448 e 0 to 0 dl 1783071429 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071418.992493:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faa0f480 with x1869685665611264 ext(0->8) 00010000:00010000:1.0:1783071418.992499:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.992512:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071418.992519:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9782faa0f480 00000100:00100000:2.0:1783071418.997851:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071418.998213:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611392 00000100:00100000:1.0:1783071418.998226:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611392 00010000:00010000:1.0:1783071418.998273:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071418.998400:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1783071418.998411:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665611392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071418.998427:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783071418.998447:0:5775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783071418.998450:0:5775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783071419 00002000:00010000:1.0:1783071418.998453:0:5775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783071419 00002000:00010000:1.0:1783071418.998455:0:5775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783071419 00010000:00010000:1.0:1783071418.998462:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.998476:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.998501:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec7894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa35 expref: 9 pid: 6585 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.998519:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071418.998524:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071418.998530:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.998540:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071418.998584:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071418.998651:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665611392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 242us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071418.998660:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00010000:00010000:3.0:1783071418.999303:0:8704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999316:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999342:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999350:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999358:0:8704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999389:0:8704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071418.999393:0:8704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999402:0:8704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999414:0:8704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071418.999421:0:8704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f146abc9/0xd360fc6ce6ec78d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071418.999487:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665611136:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 11454us (11679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071418.999494:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1783071419.001989:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.002116:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611648 00000100:00100000:0.0:1783071419.002126:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611648 00000100:00100000:0.0:1783071419.002182:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1783071419.002193:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:10478:x1869685665611648:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:0.0:1783071419.002259:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa4a expref: 38 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071419.002504:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783071419.002547:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783071419.003205:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783071419.003260:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.003276:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.003297:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.003332:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.003346:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 42 pid: 5792 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.003359:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684496256:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071419.006937:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071419.015992:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.016029:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684496256:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071419.016058:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.016211:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611776 00000100:00100000:3.0:1783071419.016218:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611776 00010000:00010000:3.0:1783071419.016260:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 43 pid: 5792 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.016301:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1783071419.016320:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:2357:x1869685665611776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071419.016335:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071419.016341:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 43 pid: 5792 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016367:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 43 pid: 5792 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016401:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec787f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa27 expref: 43 pid: 5792 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016418:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:3.0:1783071419.016423:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016433:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016450:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.016483:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071419.016483:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.016493:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.016537:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+42:2357:x1869685665611776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 218us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.016546:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000001:00080000:0.0:1783071419.016629:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783071419.016890:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1783071419.016994:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684496384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071419.017041:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071419.017076:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071419.017098:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684496384 00000100:00100000:2.0:1783071419.017104:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684496384 00000100:00100000:2.0:1783071419.017178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071419.017187:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1869685684496384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783071419.017278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1869685684496384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.017286:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071419.017972:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684496384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071419.018532:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1783071419.019855:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684496512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071419.019926:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071419.019963:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bc5780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071419.020049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684496512 00000100:00100000:3.0:1783071419.020057:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684496512 00000100:00100000:3.0:1783071419.020111:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071419.020121:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1869685684496512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783071419.020409:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5794:x1869685684496512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 289us (481us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783071419.020417:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071419.020490:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684496512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071419.020550:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1783071419.020658:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020668:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020938:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020944:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071419.020949:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020956:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020971:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071419.020974:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783071419.020978:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.020984:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071419.021153:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783071419.021252:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1783071419.021263:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320395588550ns, next at 321395586603ns, rc = 0 00000001:00080000:0.0:1783071419.021269:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1783071419.021304:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071419.021307:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783071419.021313:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec78c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa4a expref: 46 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.021424:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:10478:x1869685665611648:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 19232us (19444us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1783071419.021433:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000020:00080000:0.0:1783071419.021437:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783071419.026656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.026995:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665611904 00000100:00100000:3.0:1783071419.027005:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665611904 00000100:00100000:3.0:1783071419.027063:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:3.0:1783071419.027073:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:10478:x1869685665611904:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071419.027099:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.027121:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec78e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa51 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.027179:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec78e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa51 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.027193:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec78e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa51 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.027211:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071419.027214:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071419.027217:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071419.027271:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:10478:x1869685665611904:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 199us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.027278:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:2.0:1783071419.031589:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.031719:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665612160 00000100:00100000:0.0:1783071419.031729:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665612160 00000100:00100000:0.0:1783071419.031803:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:0.0:1783071419.031813:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:10478:x1869685665612160:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071419.032069:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10478:x1869685665612160:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 257us (501us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1783071419.032076:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1783071419.104924:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071419.104948:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c85d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684496640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071419.105015:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071419.105171:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684496640 00000100:00100000:3.0:1783071419.105178:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684496640 00000100:00100000:3.0:1783071419.105239:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071419.105249:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684496640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071419.105282:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071419.105320:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684496640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.105326:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783071419.105432:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c85d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684496640:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783071419.105462:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071419.105864:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071419.105918:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783071419.105928:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684496896:0@lo:400:kworker.0 00000100:00100000:2.0:1783071419.105962:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071419.106564:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684496896 00000100:00100000:3.0:1783071419.106571:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684496896 00000100:00100000:3.0:1783071419.106624:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783071419.106633:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684496896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.106707:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684496896:12345-0@lo:400:kworker.0 Request processed in 74us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.106716:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783071419.106729:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684496896:0@lo:400:kworker.0 00000100:00100000:1.0:1783071419.107638:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684497152:0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.107655:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684497024:0@lo:400:kworker.0 00000100:00100000:0.0:1783071419.107727:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684496768:0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.107782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071419.107823:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684497024 00000100:00100000:3.0:1783071419.107828:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684497024 00000100:00100000:3.0:1783071419.107869:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783071419.107877:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684497024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071419.107915:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.107923:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684497024:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.107932:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1783071419.107938:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071419.107956:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665612288 00000100:00100000:2.0:1783071419.107960:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665612288 00000100:00100000:3.0:1783071419.107967:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684497024:0@lo:400:kworker.0 00000100:00100000:2.0:1783071419.107991:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1783071419.107999:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10488:x1869685665612288:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1783071419.108060:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108077:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108088:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108101:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108121:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108127:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108227:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108235:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108242:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071419.108292:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108304:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108311:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108318:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108324:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.108329:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108336:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108348:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071419.108350:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.108355:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108360:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec78e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108386:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108393:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108405:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108410:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.108413:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108419:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108427:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38b00) 00010000:00010000:2.0:1783071419.108429:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.108501:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108509:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec78ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108525:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108531:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108535:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108540:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.108543:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108559:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108566:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.108568:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.108571:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.108576:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec78f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.108638:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10488:x1869685665612288:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 638us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.108644:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:1.0:1783071419.110265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071419.110411:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684497152 00000100:00100000:3.0:1783071419.110421:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684497152 00000100:00100000:3.0:1783071419.110700:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783071419.110710:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684497152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.110977:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684497152:12345-0@lo:400:kworker.0 Request processed in 268us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.110984:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783071419.111065:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684497152:0@lo:400:kworker.0 00000100:00080000:2.0:1783071419.111173:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071419.111471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071419.111558:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684496768 00000100:00100000:3.0:1783071419.111574:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684496768 00000100:00100000:3.0:1783071419.111615:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783071419.111634:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684496768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.111713:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684496768:12345-0@lo:400:kworker.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.111720:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783071419.111918:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684496768:0@lo:400:kworker.0 00000100:00100000:3.0:1783071419.152666:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.152931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665612544 00000100:00100000:0.0:1783071419.152941:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665612544 00000100:00100000:0.0:1783071419.153042:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:0.0:1783071419.153053:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:10491:x1869685665612544:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071419.153075:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071419.153109:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa58 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153180:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153194:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153204:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153217:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153223:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153228:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153346:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153356:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153363:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071419.153388:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783071419.153493:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153510:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153517:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153523:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071419.153527:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153535:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153548:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:0.0:1783071419.153551:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071419.153555:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153560:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7904 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153584:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153590:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153595:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153599:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071419.153607:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153613:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153621:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782cc2b6600) 00010000:00010000:0.0:1783071419.153623:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071419.153626:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153631:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec790b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153671:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec78fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153732:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.153739:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071419.153741:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071419.153751:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8000, rc 0) 00000100:00100000:0.0:1783071419.153967:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10491:x1869685665612544:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 915us (1308us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783071419.153975:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:1.0:1783071419.158021:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.158107:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665612672 00000100:00100000:3.0:1783071419.158118:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665612672 00000100:00100000:3.0:1783071419.158176:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:3.0:1783071419.158185:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10491:x1869685665612672:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071419.158252:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158267:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158279:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158306:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158313:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158320:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158325:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071419.158330:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158357:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158369:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071419.158381:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071419.158386:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.158391:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.158470:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10491:x1869685665612672:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 285us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.158478:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:1.0:1783071419.161861:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.162011:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665612928 00000100:00100000:0.0:1783071419.162022:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665612928 00000100:00100000:0.0:1783071419.162083:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071419.162105:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:10491:x1869685665612928:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071419.162382:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10491:x1869685665612928:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 267us (520us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783071419.162394:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:3.0:1783071419.238449:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.238540:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665613184 00000100:00100000:2.0:1783071419.238550:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665613184 00000100:00100000:2.0:1783071419.238615:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:2.0:1783071419.238624:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10501:x1869685665613184:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071419.238650:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071419.238652:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783071419.238723:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec78a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa3c expref: 50 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239016:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071419.239022:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071419.239038:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7927 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa5f expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239167:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239181:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239190:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239221:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.239234:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 50 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.239249:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684497280:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071419.239400:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071419.245574:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.245712:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665613312 00000100:00100000:2.0:1783071419.245716:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684497280:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071419.245719:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665613312 00010000:00010000:2.0:1783071419.245744:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245765:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 51 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.245802:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1783071419.245811:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:2358:x1869685665613312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071419.245826:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071419.245833:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 51 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245845:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 51 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245866:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa58 expref: 51 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245880:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071419.245885:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245894:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245901:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.245942:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071419.245998:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:2358:x1869685665613312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 187us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071419.246006:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00010000:00010000:2.0:1783071419.246322:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.246330:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071419.246350:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783071419.246523:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7927 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 51 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.246539:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 50 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.246546:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.246549:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071419.246552:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939000, rc 0) 00000100:00100000:2.0:1783071419.246590:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10501:x1869685665613184:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7967us (8152us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783071419.246597:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:1.0:1783071419.252080:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.252242:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665613568 00000100:00100000:3.0:1783071419.252252:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665613568 00000100:00100000:3.0:1783071419.252351:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:3.0:1783071419.252361:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:10501:x1869685665613568:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1783071419.252661:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.252703:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.252716:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783071419.253027:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1783071419.253145:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eef0d2d reply state 0000000054ad1c8a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.253155:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071419.253253:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10501:x1869685665613568:12345-192.168.202.16@tcp:36:bash.0 Request processed in 893us (1181us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783071419.253261:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00000020:00080000:3.0:1783071419.253265:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783071419.257208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1783071419.257317:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257329:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257336:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257342:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071419.257347:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257354:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257369:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071419.257381:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071419.257385:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.257391:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec793c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.257436:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665613696 00000100:00100000:3.0:1783071419.257445:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665613696 00000100:00100000:3.0:1783071419.257520:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:3.0:1783071419.257530:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10501:x1869685665613696:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071419.257553:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.257569:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa66 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.257639:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.257652:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 53 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.257660:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.257711:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 53 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.257723:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 53 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.257817:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c85d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684497408:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071419.257935:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071419.260443:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071419.260596:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665613824 00000100:00100000:1.0:1783071419.260606:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665613824 00010000:00010000:1.0:1783071419.260650:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 54 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.260723:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1783071419.260732:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:2357:x1869685665613824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071419.260835:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071419.260844:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 54 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.260857:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 54 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.260898:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071419.260904:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.260905:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec792e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa5f expref: 54 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.260913:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.260920:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.260921:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c85d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684497408:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071419.260937:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071419.260941:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.260949:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.260954:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071419.260998:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783071419.261002:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071419.261022:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.261026:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:2357:x1869685665613824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 294us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071419.261032:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00010000:00010000:3.0:1783071419.261050:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.261063:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.261070:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071419.261078:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071419.261081:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071419.261108:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10501:x1869685665613696:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3578us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.261114:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 106 00000100:00100000:1.0:1783071419.267121:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.267282:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614080 00000100:00100000:2.0:1783071419.267293:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614080 00000100:00100000:2.0:1783071419.267349:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1783071419.267360:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:10501:x1869685665614080:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:2.0:1783071419.267628:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10501:x1869685665614080:12345-192.168.202.16@tcp:35:bash.0 Request processed in 269us (515us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783071419.267636:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:0.0:1783071419.329830:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071419.329902:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614208 00000100:00100000:1.0:1783071419.329913:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614208 00000100:00100000:1.0:1783071419.329974:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:1.0:1783071419.329984:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:10507:x1869685665614208:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071419.330010:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071419.330031:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa6d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330155:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330171:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330193:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071419.330255:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783071419.330258:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071419.330278:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330303:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa6d expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330322:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa6d expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.330330:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:1.0:1783071419.330333:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071419.330336:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071419.330993:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665614208:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1006us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071419.331002:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 107 00000100:00100000:3.0:1783071419.333648:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.333770:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614336 00000100:00100000:2.0:1783071419.333781:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614336 00000100:00100000:2.0:1783071419.333837:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:2.0:1783071419.333847:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665614336:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071419.333866:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071419.333886:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec795f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa74 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333951:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333961:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333969:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333979:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333983:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.333987:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334226:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334232:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334237:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071419.334266:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783071419.334269:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071419.334281:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334297:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334303:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334307:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334311:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334314:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.334317:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334322:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334330:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071419.334332:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.334334:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334338:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334346:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334349:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334356:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334359:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.334361:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334364:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334368:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9b38b00) 00010000:00010000:2.0:1783071419.334380:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.334383:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334388:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec796d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334417:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec795f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334429:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 55 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.334436:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.334438:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071419.334440:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938c00, rc 0) 00000100:00100000:2.0:1783071419.334502:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10507:x1869685665614336:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 657us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.334518:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 108 00000100:00100000:3.0:1783071419.337582:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071419.337717:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614592 00000100:00100000:1.0:1783071419.337727:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614592 00000100:00100000:1.0:1783071419.337794:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:1.0:1783071419.337803:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10507:x1869685665614592:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071419.337823:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071419.337841:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec797b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa7b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.337956:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.337971:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.337981:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.337989:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.338023:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.338036:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.338049:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684497536:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071419.338440:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.338557:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614720 00000100:00100000:2.0:1783071419.338567:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614720 00010000:00010000:2.0:1783071419.338590:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 57 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.338596:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.338605:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 57 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.338615:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa08380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684497664:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071419.338623:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1783071419.338630:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:2357:x1869685665614720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071419.338639:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071419.338645:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 57 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.338651:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1300 going to sleep for 11 seconds 00010000:00010000:2.0:1783071419.338656:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 57 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.338705:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.338710:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.338717:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.338722:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071419.338758:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:2357:x1869685665614720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 128us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.338765:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1783071419.342488:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.343025:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665614848 00000100:00100000:2.0:1783071419.343058:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665614848 00010000:00010000:2.0:1783071419.343099:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 57 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.343146:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:2.0:1783071419.343156:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:2357:x1869685665614848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071419.343172:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071419.343179:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 57 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.343197:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 57 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.343220:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.343224:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.343233:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.343240:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.343257:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071419.343318:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:2357:x1869685665614848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 162us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.343324:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00010000:00010000:1.0:1783071419.343900:0:5793:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.16@tcp) returned -22 from blocking AST (req@00000000ac0bbd83 x1869685684497536) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.343916:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa74 expref: 56 pid: 6976 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.343931:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684497536:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071419.343944:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec794a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa66 expref: 55 pid: 5791 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.343952:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa08380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684497664:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071419.343970:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071419.343977:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.343985:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.343991:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071419.344011:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783071419.344173:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec797b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.344186:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.344203:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071419.344205:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783071419.344207:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3e00, rc 0) 00000100:00100000:1.0:1783071419.344255:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10507:x1869685665614592:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 6453us (6693us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783071419.344262:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 109 00000100:00100000:3.0:1783071419.350499:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071419.350599:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615104 00000100:00100000:1.0:1783071419.350609:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615104 00000100:00100000:1.0:1783071419.350719:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1783071419.350729:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10507:x1869685665615104:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:1.0:1783071419.350753:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071419.350777:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec78e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa51 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071419.350796:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:1.0:1783071419.350800:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071419.350861:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665615104:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 133us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071419.350870:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1783071419.354516:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.354615:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615232 00000100:00100000:3.0:1783071419.354627:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615232 00000100:00100000:3.0:1783071419.354726:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:3.0:1783071419.354749:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665615232:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:3.0:1783071419.354849:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.354868:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.354880:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071419.355092:0:6976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1783071419.355185:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665615232:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 449us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.355193:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 110 00000100:00100000:3.0:1783071419.358413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071419.359473:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615360 00000100:00100000:1.0:1783071419.359486:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615360 00000100:00100000:0.0:1783071419.359752:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 111 00000100:00100000:0.0:1783071419.359763:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:10507:x1869685665615360:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071419.359786:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071419.359808:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa82 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359864:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359874:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359894:0:5792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359907:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359921:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071419.359923:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071419.359927:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.359934:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8600, rc 0) 00000100:00100000:0.0:1783071419.360006:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10507:x1869685665615360:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 245us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071419.360013:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 111 00010000:00010000:0.0:1783071419.553355:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783071419.682129:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1783071419.682305:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1783071419.682316:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1783071419.682413:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:0.0:1783071419.878437:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071419.878448:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071419.878508:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783071419.878515:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071419.878655:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684497792:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071419.878777:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1783071419.885079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.885165:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615488 00000100:00100000:2.0:1783071419.885173:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615488 00000100:00100000:2.0:1783071419.885219:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:2.0:1783071419.885226:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665615488:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071419.885253:0:6976:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071419.885335:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665615488:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.885343:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 112 00000100:00100000:0.0:1783071419.885437:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684497792:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783071419.887613:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.887729:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615616 00000100:00100000:3.0:1783071419.887749:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615616 00000100:00100000:3.0:1783071419.887802:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:3.0:1783071419.887810:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10508:x1869685665615616:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783071419.887875:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887892:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887904:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887955:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887964:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887971:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.887994:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888002:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888008:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071419.888045:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783071419.888048:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071419.888070:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888081:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888087:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888094:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888100:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071419.888104:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888111:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888123:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:3.0:1783071419.888126:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071419.888130:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888150:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec799e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888165:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888171:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888178:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888188:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071419.888191:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888196:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888204:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9782d9936600) 00010000:00010000:3.0:1783071419.888206:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071419.888209:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888214:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888227:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888233:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888239:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888244:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071419.888247:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888252:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888269:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071419.888271:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071419.888274:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.888280:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071419.888355:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10508:x1869685665615616:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 544us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.888363:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 113 00000100:00100000:1.0:1783071419.890912:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.890970:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665615872 00000100:00100000:2.0:1783071419.890979:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665615872 00000100:00100000:2.0:1783071419.891073:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:2.0:1783071419.891084:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:10508:x1869685665615872:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071419.891104:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071419.891123:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa89 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891229:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891243:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891253:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071419.891263:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783071419.891392:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891400:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891406:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891412:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.891417:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891424:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891437:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071419.891439:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071419.891444:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891449:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891491:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa89 expref: 57 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891502:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:2.0:1783071419.891505:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071419.891509:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa89 expref: 57 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.891541:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071419.891605:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665615872:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 523us (699us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1783071419.891613:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:1.0:1783071419.896882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.896956:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665616000 00000100:00100000:3.0:1783071419.896965:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665616000 00000100:00100000:3.0:1783071419.897022:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1783071419.897032:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665616000:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783071419.897072:0:5793:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783071419.897185:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665616000:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.897193:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:1.0:1783071419.903715:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.903921:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665616256 00000100:00100000:3.0:1783071419.903941:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665616256 00000100:00100000:3.0:1783071419.904002:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:3.0:1783071419.904012:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665616256:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071419.904032:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.904036:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783071419.904062:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa6d expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.904090:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071419.904094:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071419.904107:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa90 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071419.904740:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783071419.905890:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.905909:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.905920:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.905988:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa90 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.906004:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa90 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.906013:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936600) 00010000:00010000:3.0:1783071419.906016:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071419.906019:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0c00, rc 0) 00000100:00100000:3.0:1783071419.906085:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10508:x1869685665616256:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2074us (2418us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1783071419.906093:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1783071419.917964:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.918059:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665616512 00000100:00100000:2.0:1783071419.918070:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665616512 00000100:00100000:2.0:1783071419.918134:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:2.0:1783071419.918144:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10508:x1869685665616512:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071419.918209:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071419.918237:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec79cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa90 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918257:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936600) 00010000:00010000:2.0:1783071419.918267:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071419.918288:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918301:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918311:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918362:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918399:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918421:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918508:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918515:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918522:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918527:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.918531:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918538:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918547:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:2.0:1783071419.918550:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.918553:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.918994:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec79dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919007:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919013:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919027:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919032:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071419.919035:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919041:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919049:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3a52d412 (ffff9782d9b38b00) 00010000:00010000:2.0:1783071419.919052:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071419.919055:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.919060:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec79e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a52d412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.919149:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665616512:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1004us (1192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071419.919157:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1783071419.923351:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.923441:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665616640 00000100:00100000:3.0:1783071419.923450:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665616640 00000100:00100000:3.0:1783071419.923508:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1783071419.923516:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:10508:x1869685665616640:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071419.923538:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.923571:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa97 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923606:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923619:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923630:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923880:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec79eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923894:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.923901:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071419.923903:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071419.923905:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071419.923948:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10508:x1869685665616640:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 434us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.923953:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:1.0:1783071419.928274:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.928637:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665616896 00000100:00100000:0.0:1783071419.928908:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665616896 00000100:00100000:0.0:1783071419.929010:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:0.0:1783071419.929021:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:10508:x1869685665616896:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071419.929114:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.929132:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.929153:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071419.929405:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1783071419.929416:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321303741051ns, next at 322303738971ns, rc = 0 00000004:00010000:0.0:1783071419.929513:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007118c271 reply state 00000000782699b0 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.929524:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071419.929631:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:10508:x1869685665616896:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 611us (1368us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1783071419.929662:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00010000:00010000:3.0:1783071419.932232:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932251:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932259:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932266:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071419.932272:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932280:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932299:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071419.932302:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783071419.932308:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.932315:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec79f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071419.934605:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.934726:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617024 00000100:00100000:3.0:1783071419.934745:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617024 00000100:00100000:3.0:1783071419.934797:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:3.0:1783071419.934807:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:10508:x1869685665617024:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071419.934831:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.934851:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaa9e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.934930:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.934945:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.934964:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071419.934967:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071419.934970:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071419.935026:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:10508:x1869685665617024:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 220us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.935032:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:1.0:1783071419.940390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.940477:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617152 00000100:00100000:2.0:1783071419.940486:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617152 00000100:00100000:2.0:1783071419.940538:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1783071419.940548:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665617152:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783071419.941046:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665617152:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 497us (663us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783071419.941054:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1783071419.944599:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.944758:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617408 00000100:00100000:3.0:1783071419.944770:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617408 00000100:00100000:3.0:1783071419.944826:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1783071419.944835:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:10508:x1869685665617408:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783071419.945059:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:10508:x1869685665617408:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 224us (469us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783071419.945067:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1783071419.947394:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.947559:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617664 00000100:00100000:2.0:1783071419.947577:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617664 00000100:00100000:2.0:1783071419.947635:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:2.0:1783071419.947644:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:10508:x1869685665617664:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783071419.948006:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:10508:x1869685665617664:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 362us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.948015:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1783071419.950356:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071419.950458:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617792 00000100:00100000:3.0:1783071419.950469:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617792 00000100:00100000:3.0:1783071419.950532:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:3.0:1783071419.950542:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:10508:x1869685665617792:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071419.950573:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071419.950608:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaa5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.950931:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.950946:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.950957:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071419.950992:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071419.951010:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.951038:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaa5 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.951057:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaa5 expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071419.951066:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071419.951069:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071419.951072:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1a00, rc 0) 00000100:00100000:3.0:1783071419.951133:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:10508:x1869685665617792:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 593us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071419.951141:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1783071419.954245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.954339:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665617920 00000100:00100000:0.0:1783071419.954350:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665617920 00000100:00100000:0.0:1783071419.954418:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1783071419.954428:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665617920:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071419.954446:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071419.954466:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaac expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071419.954492:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4782bc, blocks: 0x1 00010000:00010000:0.0:1783071419.954508:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1783071419.954513:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071419.954522:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 10 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.954541:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 10 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.954554:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9800, rc 0) 00000100:00100000:0.0:1783071419.954619:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2358:x1869685665617920:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 193us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071419.954626:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1783071419.957756:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.957883:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618176 00000100:00100000:0.0:1783071419.957893:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618176 00000100:00100000:0.0:1783071419.957954:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:0.0:1783071419.957964:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:10508:x1869685665618176:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071419.958089:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:10508:x1869685665618176:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 126us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071419.958097:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:1.0:1783071419.961022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.961115:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618304 00000100:00100000:2.0:1783071419.961125:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618304 00000100:00100000:2.0:1783071419.961184:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1783071419.961194:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:10508:x1869685665618304:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071419.961212:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071419.961232:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaab3 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.961263:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.961272:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071419.961276:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071419.961280:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.961313:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.961347:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 11 pid: 6587 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.961362:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684497920:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071419.961475:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071419.964459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.964544:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618432 00000100:00100000:0.0:1783071419.964554:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618432 00010000:00010000:0.0:1783071419.964605:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 12 pid: 6587 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.964645:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1783071419.964662:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2358:x1869685665618432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071419.964732:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071419.964764:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 12 pid: 6587 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.964777:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 12 pid: 6587 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.964800:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071419.964804:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071419.964813:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.964823:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071419.964858:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071419.964878:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684498048:192.168.202.16@tcp:105: 00000100:00100000:0.0:1783071419.964952:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00010000:00010000:2.0:1783071419.966017:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7a15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaac expref: 12 pid: 6587 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071419.966037:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684497920:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071419.966061:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071419.966073:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:2.0:1783071419.966127:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:10508:x1869685665618304:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 4934us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071419.966135:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1783071419.971579:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684498048:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071419.971608:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071419.972032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071419.972109:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618560 00000100:00100000:2.0:1783071419.972117:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618560 00002000:00100000:2.0:1783071419.972165:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9782f9bf5c00 x1869685665618560/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:10/0 lens 504/0 e 0 to 0 dl 1783071430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071419.972177:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782f9bf5c00 with x1869685665618560 ext(0->12) 00002000:00010000:2.0:1783071419.972182:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782f9bf5c00 00000100:00100000:2.0:1783071419.972211:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1783071419.972237:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:2357:x1869685665618560:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783071419.972725:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2357:x1869685665618560:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 487us (692us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783071419.972734:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:2.0:1783071419.972750:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9782f9bf5c00 x1869685665618560/t4294967308(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:10/0 lens 504/448 e 0 to 0 dl 1783071430 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071419.972759:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782f9bf5c00 with x1869685665618560 ext(0->12) 00002000:00010000:2.0:1783071419.972764:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782f9bf5c00 00000100:00100000:0.0:1783071419.972956:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2358:x1869685665618432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8294us (8505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071419.972966:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1783071419.976035:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071419.976138:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618688 00000100:00100000:0.0:1783071419.976149:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618688 00000100:00100000:0.0:1783071419.976208:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:0.0:1783071419.976218:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:10508:x1869685665618688:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783071420.011146:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:10508:x1869685665618688:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 34921us (35112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.011159:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000001:00080000:0.0:1783071420.011199:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1783071420.011205:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1783071420.011235:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1783071420.011253:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782c6bc5180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1783071420.011258:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782ede1c000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782c6bc5b40 00000020:00080000:0.0:1783071420.011261:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782ede1cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9782c5d8c400 00000020:00080000:0.0:1783071420.011295:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1783071420.011330:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782c6bc5480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1783071420.011334:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c62cd600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782c6bc5240 00000020:00080000:0.0:1783071420.011350:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c62cda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9782fa789800 00000001:00080000:0.0:1783071420.011359:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1783071420.011385:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783071420.011519:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1783071420.011885:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783071420.011902:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684498304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783071420.011958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071420.011992:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071420.011998:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684498176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783071420.012020:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071420.012047:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684498304 00000100:00100000:0.0:1783071420.012054:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684498304 00000100:00100000:0.0:1783071420.012088:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684498176 00000100:00100000:0.0:1783071420.012092:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684498176 00000100:00100000:0.0:1783071420.012110:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071420.012117:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1869685684498304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783071420.012250:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783071420.012254:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783071420 00002000:00010000:0.0:1783071420.012256:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783071420.012258:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783071420 -> 1783071420 00002000:00010000:0.0:1783071420.012260:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783071420.012295:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1869685684498304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (337us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783071420.012302:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071420.012315:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783071420.012321:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1869685684498176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783071420.012334:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1783071420.012360:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.012392:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.012400:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783071420.012405:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.012410:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.012439:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.012452:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 11 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.012463:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6587:1869685684498432:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071420.012516:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00000004:00080000:0.0:1783071420.012558:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782f9c6ed80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1783071420.012565:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684498304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783071420.016036:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684498560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783071420.016107:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071420.016817:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684498560 00000100:00100000:3.0:1783071420.016826:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684498560 00000100:00100000:3.0:1783071420.016893:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783071420.016903:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684498560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783071420.016930:0:6585:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1783071420.016963:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4782bb, atime: 0x6a4782bb, ctime: 0x6a4782bb, blocks: 0xb 00010000:00010000:3.0:1783071420.016971:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.016986:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1783071420.016991:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071420.016996:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.017011:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.017022:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.017030:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.017049:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783071420.017519:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071420.018124:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684498560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1219us (2013us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783071420.018133:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1783071420.018160:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071420.018166:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.018183:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071420.018187:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.018198:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.018215:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.018224:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452de795/0xd360fc6ce6ec7a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.018243:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071420.018245:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071420.018246:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071420.018819:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.018849:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618816 00000100:00100000:0.0:1783071420.018856:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618816 00010000:00010000:0.0:1783071420.018894:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 12 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.018934:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1783071420.018942:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2358:x1869685665618816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071420.018955:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071420.018960:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 12 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.018971:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 12 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.018988:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.018992:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.018998:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.019006:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.019023:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071420.019062:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2358:x1869685665618816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.019069:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00080000:0.0:1783071420.019152:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783071420.019542:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec77e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa12 expref: 11 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071420.019569:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6587:1869685684498432:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071420.019589:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.019600:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.019608:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.019618:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.019633:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.019658:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071420.020215:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1869685684498176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7891us (8191us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783071420.020243:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1783071420.020776:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071420.020784:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.020803:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071420.020807:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.020817:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.020835:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.020843:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec7a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.020864:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071420.020865:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071420.020867:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783071420.020899:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782f9c6c380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783071420.020905:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684498176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783071420.022439:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.022545:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665618944 00000100:00100000:3.0:1783071420.022553:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665618944 00000100:00100000:3.0:1783071420.022618:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1783071420.022628:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:2356:x1869685665618944:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783071420.023590:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783071420.023598:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1783071420.023616:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782c85d1c00, transno 4294967301 00000004:00080000:2.0:1783071420.023631:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1783071420.023653:0:3294:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9782f9d2fb80 x1869685684498560/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783071436 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783071420.023665:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782f9d2fb80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1783071420.023670:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684498560:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1783071420.058098:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1783071420.058122:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1783071420.058130:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1783071420.058138:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1783071420.058317:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665618944:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 35684us (35877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071420.058330:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071420.060870:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.060919:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619200 00000100:00100000:3.0:1783071420.060929:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619200 00000100:00080000:0.0:1783071420.060989:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071420.061013:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:3.0:1783071420.061023:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10508:x1869685665619200:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071420.061078:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071420.061102:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaa5 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.061127:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071420.061130:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071420.061156:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.061166:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.061173:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071420.061404:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8b2542d reply state 00000000f6eec532 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.061413:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071420.061528:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:10508:x1869685665619200:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 496us (654us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1783071420.061536:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00010000:00010000:3.0:1783071420.063386:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063401:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063409:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063428:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.063433:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063441:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063457:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071420.063460:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071420.063466:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.063471:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.064614:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.065019:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619328 00000100:00100000:3.0:1783071420.065029:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619328 00000100:00100000:3.0:1783071420.065085:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1783071420.065095:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665619328:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783071420.065302:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783071420.065305:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783071420 -> 1783071419 00002000:00010000:3.0:1783071420.065306:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783071419 00002000:00010000:3.0:1783071420.065308:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783071420 -> 1783071419 00002000:00010000:3.0:1783071420.065309:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783071420.065358:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665619328:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 265us (752us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783071420.065375:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1783071420.067599:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.067965:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619584 00000100:00100000:3.0:1783071420.067980:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619584 00000100:00100000:3.0:1783071420.068045:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:3.0:1783071420.068053:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:10508:x1869685665619584:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783071420.068113:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.068133:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.068140:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.068174:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.068183:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 15 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.068193:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684498688:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071420.068262:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071420.072668:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.072756:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619712 00000100:00100000:0.0:1783071420.072766:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619712 00010000:00010000:0.0:1783071420.072811:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.072854:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1783071420.072864:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:2357:x1869685665619712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071420.072879:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071420.072886:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.072898:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.072919:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:0.0:1783071420.072924:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.072933:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.072941:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.072958:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071420.073014:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:2357:x1869685665619712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 150us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.073021:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00010000:00010000:3.0:1783071420.075877:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec79f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa97 expref: 15 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.075902:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684498688:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071420.075927:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.075937:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.075961:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.075994:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076003:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076011:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076018:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.076022:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076029:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076045:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071420.076048:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783071420.076052:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.076057:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.076146:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10508:x1869685665619584:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 8092us (8555us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783071420.076156:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1783071420.079516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.079779:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619840 00000100:00100000:0.0:1783071420.079801:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619840 00000100:00100000:0.0:1783071420.079896:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1783071420.079917:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665619840:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783071420.079956:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.079972:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.079978:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071420.079981:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.079984:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.080007:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.080016:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 7 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.080026:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6585:1869685684498816:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071420.080091:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071420.082060:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6585:1869685684498816:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071420.082084:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071420.084195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.084272:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665619968 00000100:00100000:0.0:1783071420.084279:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665619968 00010000:00010000:0.0:1783071420.084315:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 8 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.084350:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1783071420.084357:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665619968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071420.084384:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071420.084402:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 8 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.084411:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 8 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.084428:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c12aa9d/0xd360fc6ce6ec7a1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaab3 expref: 8 pid: 6588 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.084441:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.084444:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071420.084448:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.084454:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.084490:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071420.084538:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665619968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 180us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.084545:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00010000:00010000:3.0:1783071420.084605:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084612:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084631:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084636:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084641:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084645:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071420.084649:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084657:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084668:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.084713:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5255dfa/0xd360fc6ce6ec7a3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.084768:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665619840:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 4862us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071420.084776:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:1.0:1783071420.090102:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071420.090184:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665620224 00000100:00100000:2.0:1783071420.090193:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665620224 00000100:00100000:2.0:1783071420.090241:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:2.0:1783071420.090253:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10508:x1869685665620224:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071420.090318:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090331:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090340:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090567:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090579:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090587:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090619:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.090633:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 15 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071420.090648:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684498944:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071420.090968:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071420.094077:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.094160:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665620352 00000100:00100000:0.0:1783071420.094169:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665620352 00010000:00010000:0.0:1783071420.094203:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071420.094233:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1783071420.094240:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:2358:x1869685665620352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071420.094252:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071420.094257:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.094265:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 16 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.094282:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:0.0:1783071420.094285:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.094292:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.094296:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071420.094321:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071420.094381:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:2358:x1869685665620352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.094390:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00010000:00010000:2.0:1783071420.094578:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa9e expref: 15 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071420.094602:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684498944:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071420.094620:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.094627:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.094631:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071420.094841:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1783071420.094992:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1783071420.095038:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1783071420.095111:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684499072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783071420.095157:0:6976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071420.095220:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63ac240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071420.098795:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684499072 00000100:00100000:3.0:1783071420.098811:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684499072 00000100:00100000:2.0:1783071420.099002:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783071420.099014:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684499072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783071420.099153:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684499072:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (3994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071420.099161:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071420.099229:0:6976:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783071420.099236:0:6976:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1783071420.099255:0:6976:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782f9c6ed80, transno 4294967309 00000004:00080000:3.0:1783071420.099275:0:6976:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782f9c6c380, transno 4294967310 00000100:00100000:3.0:1783071420.099283:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684499072:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783071420.099962:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1783071420.100037:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684499200:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783071420.100082:0:6976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071420.100658:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071420.100760:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684499200 00000100:00100000:2.0:1783071420.100766:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684499200 00000100:00100000:2.0:1783071420.100801:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783071420.100809:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684499200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783071420.101048:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6976:x1869685684499200:12345-0@lo:1000:mdt00_003.0 Request processed in 239us (963us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783071420.101063:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071420.101178:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684499200:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783071420.101216:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101226:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101234:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101240:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.101244:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101259:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101273:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9936c00) 00010000:00010000:3.0:1783071420.101276:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071420.101282:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101288:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7a4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101318:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101325:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101331:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101336:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.101339:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101345:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101353:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071420.101355:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071420.101362:0:6976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101394:0:6976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101403:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.101431:0:6976:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.101441:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684499328:192.168.202.16@tcp:105: 00000100:00100000:3.0:1783071420.101527:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071420.104081:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684499328:192.168.202.16@tcp:105: 00010000:00010000:3.0:1783071420.104110:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104121:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7990 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104156:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104170:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104181:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104191:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104209:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104215:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104221:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.104225:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104231:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104239:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071420.104241:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071420.104243:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104247:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104253:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104257:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104260:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104263:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.104270:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104273:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104278:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071420.104279:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071420.104281:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.104284:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7a46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.104500:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10508:x1869685665620224:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 14245us (14404us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1783071420.104509:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000020:00080000:3.0:1783071420.104515:0:6976:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783071420.104983:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071420.104988:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071420.105006:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783071420.105017:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071420.105326:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071420.105384:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665620480 00000100:00100000:0.0:1783071420.105389:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665620480 00000100:00100000:0.0:1783071420.105423:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1783071420.105429:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10507:x1869685665620480:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:0.0:1783071420.105516:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10507:x1869685665620480:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.105521:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1783071420.108989:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071420.109036:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071420.109100:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665620992 00000100:00100000:2.0:1783071420.109109:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665620992 00000100:00100000:2.0:1783071420.109170:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:2.0:1783071420.109180:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:10508:x1869685665620992:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783071420.109914:0:11813:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783071420.110008:0:11813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1783071420.110049:0:11813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110062:0:11813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110072:0:11813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110080:0:11813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110086:0:11813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110092:0:11813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.110107:0:11813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783071420.110200:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:10508:x1869685665620992:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1019us (1160us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1783071420.110208:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000020:00080000:2.0:1783071420.110221:0:11813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783071420.110485:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071420.110493:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.110500:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071420.110504:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.110511:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.110523:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9782d9b38b00) 00010000:00010000:1.0:1783071420.110526:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071420.110530:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.110541:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7a5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071420.110559:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071420.110561:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071420.110563:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071420.110712:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665620736 00000100:00100000:0.0:1783071420.110720:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665620736 00000100:00100000:0.0:1783071420.110759:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:0.0:1783071420.110767:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:10507:x1869685665620736:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:0.0:1783071420.110946:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1783071420.111006:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:10507:x1869685665620736:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 239us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.111013:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1783071420.162004:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.162123:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621120 00000100:00100000:3.0:1783071420.162133:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621120 00000100:00100000:3.0:1783071420.162231:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:3.0:1783071420.162240:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:10510:x1869685665621120:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071420.162260:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071420.162276:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaba expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162351:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162361:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162392:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162413:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162420:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162425:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162783:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162796:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162805:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162838:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.162853:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 21 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071420.162865:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684499456:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071420.163260:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854180 going to sleep for 11 seconds 00000100:00100000:3.0:1783071420.166954:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684499456:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071420.166995:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071420.168747:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071420.170041:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621376 00000100:00100000:3.0:1783071420.170051:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621376 00000100:00100000:3.0:1783071420.170104:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1783071420.170114:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:6028:x1869685665621376:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071420.170339:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:6028:x1869685665621376:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 225us (1607us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1783071420.170348:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071420.175124:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071420.175220:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621504 00000100:00100000:2.0:1783071420.175230:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621504 00010000:00010000:2.0:1783071420.175272:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 23 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071420.175315:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1783071420.175324:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:2358:x1869685665621504:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071420.175338:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071420.175343:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 23 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175354:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 23 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175391:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7982 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa7b expref: 23 pid: 5793 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175410:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:2.0:1783071420.175416:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175425:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175433:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071420.175459:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071420.175507:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:2358:x1869685665621504:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 184us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071420.175535:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00010000:00010000:3.0:1783071420.175838:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175848:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071420.175892:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783071420.175896:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071420.175915:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175928:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175938:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175944:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175961:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175967:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.175972:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175979:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175988:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071420.175990:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071420.175993:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.175997:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7a69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176005:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176008:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176012:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176015:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071420.176017:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176027:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176032:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9782d9936c00) 00010000:00010000:3.0:1783071420.176033:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071420.176035:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176038:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176065:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaba expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176074:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaba expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071420.176079:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071420.176080:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071420.176081:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0c00, rc 0) 00000100:00100000:3.0:1783071420.176114:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:10510:x1869685665621120:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 13875us (14122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071420.176121:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:1.0:1783071420.353772:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071420.353817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071420.353856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071420.353888:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621888 00000100:00100000:1.0:1783071420.353897:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621888 00000100:00100000:1.0:1783071420.353960:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:1.0:1783071420.353969:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665621888:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071420.354042:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665621888:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071420.354049:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00080000:1.0:1783071420.354071:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071420.354216:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621760 00000100:00100000:3.0:1783071420.354221:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621760 00000100:00100000:3.0:1783071420.354265:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1783071420.354272:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665621760:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071420.354319:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665621760:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071420.354326:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071420.354891:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665621632 00000100:00100000:0.0:1783071420.354898:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665621632 00000100:00100000:0.0:1783071420.354938:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 277 00000100:00100000:0.0:1783071420.354956:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665621632:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071420.354995:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665621632:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 42us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071420.355001:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 277 00000100:00080000:1.0:1783071420.355133:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783071420.576858:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071421.024060:0:11960:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071421.024071:0:11960:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071421.024118:0:11960:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783071421.024131:0:11960:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783071421.154864:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783071421.154873:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783071421.154930:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783071421.154937:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071421.155066:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684499584:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071421.155160:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb58c240 going to sleep for 11 seconds 00000100:00100000:1.0:1783071421.170223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071421.170304:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665622016 00000100:00100000:1.0:1783071421.170314:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665622016 00000100:00100000:1.0:1783071421.170381:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:1.0:1783071421.170393:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:10523:x1869685665622016:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783071421.170430:0:6976:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783071421.170541:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:10523:x1869685665622016:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 149us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071421.170550:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:3.0:1783071421.177846:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071421.177885:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665622272 00000100:00100000:3.0:1783071421.177895:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665622272 00000100:00100000:3.0:1783071421.177946:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1783071421.177957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:10523:x1869685665622272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071421.177980:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783071421.178648:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684499584:192.168.202.16@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1783071421.179117:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaac1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.179224:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.179241:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.179254:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071421.179266:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783071421.179377:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7a7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac1 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.179393:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac1 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.179416:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071421.179418:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071421.179421:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071421.179490:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:10523:x1869685665622272:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1653us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1783071421.179499:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1783071421.186722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071421.186759:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665622400 00000100:00100000:3.0:1783071421.186769:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665622400 00000100:00100000:3.0:1783071421.186828:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1783071421.186838:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:2357:x1869685665622400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071421.186855:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071421.186881:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac1 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.186898:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071421.186904:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071421.186957:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:2357:x1869685665622400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071421.186965:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1783071421.191380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071421.193501:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665622656 00000100:00100000:3.0:1783071421.193514:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665622656 00000100:00100000:3.0:1783071421.193589:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1783071421.193601:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:10523:x1869685665622656:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783071421.193697:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193721:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193733:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193908:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193916:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193923:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193929:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071421.193932:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193939:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193950:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071421.193953:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071421.193958:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071421.193964:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7a93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071421.194503:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:10523:x1869685665622656:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 902us (3127us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783071421.194519:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000040:00080000:0.0:1783071421.195568:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071421.195576:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071421.196234:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783071421.196252:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071421.202840:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071421.202962:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665622912 00000100:00100000:0.0:1783071421.202972:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665622912 00000100:00100000:0.0:1783071421.203039:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1783071421.203049:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:10523:x1869685665622912:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783071421.203297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:10523:x1869685665622912:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 248us (467us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783071421.203304:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00010000:00010000:1.0:1783071421.602514:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071422.626189:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071422.827991:0:12011:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071422.828002:0:12011:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071422.828046:0:12011:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783071422.828052:0:12011:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071423.004866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071423.004948:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623168 00000100:00100000:0.0:1783071423.004958:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623168 00000100:00100000:0.0:1783071423.005027:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:0.0:1783071423.005039:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:10543:x1869685665623168:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071423.005063:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071423.005092:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7a9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaac8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071423.005196:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7aa1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071423.005211:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071423.005224:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071423.005236:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783071423.005382:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7a9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac8 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071423.005400:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac8 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071423.005409:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:0.0:1783071423.005412:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783071423.005416:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8000, rc 0) 00000100:00100000:0.0:1783071423.005474:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:10543:x1869685665623168:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 438us (616us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1783071423.005481:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00080000:3.0:1783071423.005930:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071423.010994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071423.011101:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623296 00000100:00100000:3.0:1783071423.011112:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623296 00000100:00100000:3.0:1783071423.011178:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:3.0:1783071423.011190:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:10543:x1869685665623296:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071423.011262:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011281:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011292:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011316:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011322:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011330:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011336:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071423.011351:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011376:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011389:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071423.011392:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071423.011396:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.011403:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1200/0xd360fc6ce6ec7aaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071423.011487:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:10543:x1869685665623296:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 298us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.011495:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:0.0:1783071423.113957:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071423.115767:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623424 00000100:00100000:3.0:1783071423.115781:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623424 00000100:00100000:3.0:1783071423.115867:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1783071423.115880:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665623424:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:3.0:1783071423.115904:0:8704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071423.115926:0:8704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000747385a1/0xd360fc6ce6ec7ab6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaacf expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071423.115966:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4782bb, atime: 0x6a4782bb, ctime: 0x6a4782bb, blocks: 0xb 00010000:00010000:3.0:1783071423.115988:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1783071423.115993:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071423.116002:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000747385a1/0xd360fc6ce6ec7ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaacf expref: 7 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.116042:0:8704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000747385a1/0xd360fc6ce6ec7ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaacf expref: 7 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071423.116055:0:8704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1200, rc 0) 00000100:00100000:3.0:1783071423.116113:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665623424:12345-192.168.202.16@tcp:101:cat.0 Request processed in 236us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.116121:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00080000:0.0:1783071423.116253:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071423.121051:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071423.121150:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623552 00000100:00100000:1.0:1783071423.121160:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623552 00002000:00100000:1.0:1783071423.121208:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9782faa0fb80 x1869685665623552/t0(0) o3->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:14/0 lens 488/0 e 0 to 0 dl 1783071434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071423.121221:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faa0fb80 with x1869685665623552 ext(0->4095) 00002000:00010000:1.0:1783071423.121227:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782faa0fb80 00000100:00100000:1.0:1783071423.121260:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1783071423.121270:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2356:x1869685665623552:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:1.0:1783071423.121512:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2356:x1869685665623552:12345-192.168.202.16@tcp:3:cat.0 Request processed in 243us (469us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783071423.121520:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:1.0:1783071423.121527:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9782faa0fb80 x1869685665623552/t0(0) o3->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:14/0 lens 488/4536 e 0 to 0 dl 1783071434 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071423.121536:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faa0fb80 with x1869685665623552 ext(0->4095) 00002000:00010000:1.0:1783071423.121539:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782faa0fb80 00010000:00010000:1.0:1783071423.648899:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071423.713181:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684499712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071423.713256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071423.713699:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684499712 00000100:00100000:3.0:1783071423.713711:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684499712 00000100:00100000:3.0:1783071423.713772:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071423.713785:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684499712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071423.713845:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071423.713906:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684499712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071423.713913:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783071423.713970:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684499712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783071423.714414:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071424.226221:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684499840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071424.226293:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.226391:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684499840 00000100:00100000:2.0:1783071424.226400:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684499840 00000100:00100000:2.0:1783071424.226453:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071424.226464:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1869685684499840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071424.226499:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071424.226890:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1869685684499840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 427us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.226898:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783071424.226955:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684499840:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783071424.227538:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071424.240145:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684499968:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240215:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.240278:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071424.240284:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684500352:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240313:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.240358:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684500096:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240381:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.240400:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071424.240405:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684500224:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240424:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071424.240457:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684499968 00000100:00100000:2.0:1783071424.240464:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684499968 00000100:00100000:2.0:1783071424.240510:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783071424.240519:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684499968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240569:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684499968:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.240577:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783071424.240608:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500352 00000100:00100000:2.0:1783071424.240612:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500352 00000100:00100000:2.0:1783071424.240644:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500096 00000100:00100000:2.0:1783071424.240647:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500096 00000100:00100000:2.0:1783071424.240663:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500224 00000100:00100000:2.0:1783071424.240666:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500224 00000100:00100000:2.0:1783071424.240705:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783071424.240712:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684500352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240744:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684500352:12345-0@lo:400:kworker.0 Request processed in 33us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.240751:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783071424.240762:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783071424.240768:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684500096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240810:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684500096:12345-0@lo:400:kworker.0 Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.240816:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783071424.240827:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783071424.240834:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684500224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.240862:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684500224:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071424.240868:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1783071424.240952:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071424.240996:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684500224:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.241007:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684500096:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.241037:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684500352:0@lo:400:kworker.0 00000100:00100000:2.0:1783071424.241045:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684499968:0@lo:400:kworker.0 00010000:00010000:0.0:1783071424.672910:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783071424.785397:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1783071425.313157:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1783071425.313189:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1783071425.313235:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782cb854480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1783071425.313241:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782faca3c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782cb854c00 00000020:00080000:0.0:1783071425.313245:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782faca3d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9782f9d2b000 00000020:00080000:0.0:1783071425.313260:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783071425.313458:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1783071425.343769:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1783071425.343785:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1783071425.475035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071425.475063:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071425.475090:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071425.475108:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071425.475126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071425.475151:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624192 00000100:00100000:2.0:1783071425.475160:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624192 00000100:00100000:2.0:1783071425.475208:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623808 00000100:00100000:2.0:1783071425.475210:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623808 00000100:00100000:2.0:1783071425.475227:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1783071425.475245:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665624192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071425.475334:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665624192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071425.475348:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1783071425.475367:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:2.0:1783071425.475374:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2357:x1869685665623808:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071425.475399:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2357:x1869685665623808:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071425.475405:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00080000:2.0:1783071425.475435:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071425.475577:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623936 00000100:00100000:0.0:1783071425.475582:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623936 00000100:00100000:0.0:1783071425.475628:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624064 00000100:00100000:0.0:1783071425.475631:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624064 00000100:00100000:0.0:1783071425.475654:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1783071425.475660:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665623936:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071425.475719:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665623936:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 59us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071425.475726:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1783071425.475740:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1783071425.475746:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665624064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071425.475769:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665624064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071425.475775:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00080000:2.0:1783071425.480581:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071425.480604:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071425.480963:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665623680 00000100:00100000:3.0:1783071425.480976:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665623680 00000100:00100000:3.0:1783071425.481105:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 279 00000100:00100000:3.0:1783071425.481116:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665623680:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071425.481195:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665623680:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (6170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071425.481203:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 279 00010000:00010000:1.0:1783071425.697936:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071426.721982:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071427.503417:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071427.503518:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624320 00000100:00100000:0.0:1783071427.503528:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624320 00000100:00100000:0.0:1783071427.503610:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1783071427.503641:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10188:x1869685665624320:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783071427.503809:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10188:x1869685665624320:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 171us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071427.503817:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00080000:2.0:1783071427.503883:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071427.518082:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071427.518300:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624576 00000100:00100000:0.0:1783071427.518319:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624576 00000100:00100000:0.0:1783071427.518700:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1783071427.518713:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:10188:x1869685665624576:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783071427.520065:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:10188:x1869685665624576:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1348us (1986us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1783071427.520077:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00010000:00010000:1.0:1783071427.744994:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071427.957131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071427.957193:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624704 00000100:00100000:2.0:1783071427.957203:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624704 00000100:00100000:2.0:1783071427.959727:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:2.0:1783071427.959744:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:10994:x1869685665624704:12345-192.168.202.16@tcp:101:lsof.0 00010000:00010000:2.0:1783071427.959766:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071427.959788:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaad6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.959849:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.959861:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.959881:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071427.960116:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783071427.960119:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071427.960185:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.960205:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.960449:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071427.960458:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071427.960460:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071427.960570:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071427.960755:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:10994:x1869685665624704:12345-192.168.202.16@tcp:101:lsof.0 Request processed in 1015us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071427.960763:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00080000:0.0:1783071427.961862:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071428.769236:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071428.832971:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684500480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071428.833060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071428.833202:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500480 00000100:00100000:3.0:1783071428.833224:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500480 00000100:00100000:3.0:1783071428.833309:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783071428.833319:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684500480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071428.833353:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783071428.833423:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071428.838886:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684500480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5556us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071428.838902:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783071428.842179:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783071428.842190:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782f9d2fb80, transno 4294967304 00000100:00100000:2.0:1783071428.842228:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684500480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071429.344987:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684500608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071429.345075:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071429.345109:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500608 00000100:00100000:2.0:1783071429.345131:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500608 00000100:00100000:2.0:1783071429.345192:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1783071429.345194:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071429.345204:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684500608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071429.345240:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071429.345416:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684500608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071429.345424:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783071429.348754:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684500864:0@lo:400:kworker.0 00000100:00100000:0.0:1783071429.348833:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071429.348875:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071429.348881:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684500992:0@lo:400:kworker.0 00000100:00100000:0.0:1783071429.348905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071429.348959:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500864 00000100:00100000:0.0:1783071429.348966:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500864 00000100:00100000:0.0:1783071429.349001:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500992 00000100:00100000:0.0:1783071429.349003:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500992 00000100:00100000:0.0:1783071429.349028:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783071429.349036:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684500864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071429.349084:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684500864:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071429.349105:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783071429.349123:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783071429.349130:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684500992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071429.349160:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684500992:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071429.349166:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1783071429.349185:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071429.349212:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684500992:0@lo:400:kworker.0 00000100:00100000:0.0:1783071429.349223:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684500864:0@lo:400:kworker.0 00000100:00100000:2.0:1783071429.349976:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684500736:0@lo:400:kworker.0 00000100:00100000:2.0:1783071429.350022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071429.350070:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071429.350077:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684501120:0@lo:400:kworker.0 00000100:00100000:2.0:1783071429.350101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071429.350144:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684501120 00000100:00100000:2.0:1783071429.350149:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684501120 00000100:00100000:2.0:1783071429.350190:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783071429.350198:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684501120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071429.350238:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1869685684501120:12345-0@lo:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071429.350244:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1783071429.350262:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071429.350283:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684501120:0@lo:400:kworker.0 00000100:00100000:1.0:1783071429.350437:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684500736 00000100:00100000:1.0:1783071429.350442:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684500736 00000100:00100000:1.0:1783071429.350480:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783071429.350487:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684500736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071429.350526:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3295:x1869685684500736:12345-0@lo:400:kworker.0 Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071429.350533:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783071429.350567:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684500736:0@lo:400:kworker.0 00000100:00100000:3.0:1783071429.353149:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1783071429.353160:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1783071429.353195:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684500608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783071429.792974:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783071430.428469:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1783071430.428492:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1783071430.428509:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1783071430.428520:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1783071430.432855:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071430.432863:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071430.433133:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1783071430.433139:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071430.592461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071430.592613:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071430.592670:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071430.592724:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071430.592747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071430.592885:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625216 00000100:00100000:1.0:1783071430.592896:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625216 00000100:00100000:1.0:1783071430.592953:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625088 00000100:00100000:1.0:1783071430.592956:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625088 00000100:00100000:1.0:1783071430.592980:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1783071430.592991:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665625216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071430.593067:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2356:x1869685665625216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 78us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071430.593075:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1783071430.593093:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1783071430.593100:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665625088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071430.593126:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2356:x1869685665625088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071430.593154:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00080000:1.0:1783071430.594449:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071430.594459:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071430.594489:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624832 00000100:00100000:1.0:1783071430.594498:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624832 00000100:00100000:1.0:1783071430.594547:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:1.0:1783071430.594556:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665624832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071430.594617:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665624832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 62us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071430.594625:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:3.0:1783071430.596025:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665624960 00000100:00100000:3.0:1783071430.596036:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665624960 00000100:00100000:3.0:1783071430.596093:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625344 00000100:00100000:3.0:1783071430.596097:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625344 00000100:00100000:3.0:1783071430.596120:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:3.0:1783071430.596128:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2356:x1869685665624960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071430.596198:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2356:x1869685665624960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (3746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071430.596205:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:3.0:1783071430.596221:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:3.0:1783071430.596236:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2356:x1869685665625344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071430.596265:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2356:x1869685665625344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071430.596270:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00080000:3.0:1783071430.597223:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1783071430.688386:0:12213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:37:09 (1783071429) 00010000:00010000:2.0:1783071430.818892:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071431.782957:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071431.783061:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625600 00000100:00100000:3.0:1783071431.783071:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625600 00000100:00100000:3.0:1783071431.783131:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1783071431.783141:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:11259:x1869685665625600:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071431.783162:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071431.783181:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7acb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaadd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783261:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783287:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783302:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783316:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783333:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783357:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783840:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7ae0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783850:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.783858:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071431.783867:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783071431.784052:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784059:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784065:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784071:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071431.784075:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784082:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784093:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782cc2b6b00) 00010000:00010000:3.0:1783071431.784096:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071431.784106:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784113:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7ad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784126:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784132:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784138:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784143:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071431.784145:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784150:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784157:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9782d9936600) 00010000:00010000:3.0:1783071431.784159:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071431.784162:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784167:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7ad9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784525:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7acb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaadd expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784550:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaadd expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.784556:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:3.0:1783071431.784558:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071431.784561:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071431.788492:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11259:x1869685665625600:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 5336us (5538us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1783071431.788506:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1783071431.802040:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071431.802435:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625728 00000100:00100000:2.0:1783071431.802446:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625728 00000100:00100000:2.0:1783071431.802565:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:2.0:1783071431.802577:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11259:x1869685665625728:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783071431.802717:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11259:x1869685665625728:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 143us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071431.802723:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:2.0:1783071431.812537:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071431.812618:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625856 00000100:00100000:3.0:1783071431.812628:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625856 00000100:00100000:3.0:1783071431.812741:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071431.812753:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:2358:x1869685665625856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071431.812770:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071431.812795:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7ae0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaadd expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071431.812815:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:3.0:1783071431.812821:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071431.812887:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:2358:x1869685665625856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 136us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071431.812895:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00010000:00010000:1.0:1783071431.840936:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071432.483093:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071432.483104:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071432.483140:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1783071432.483148:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783071432.872045:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071433.574291:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071433.574361:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665625984 00000100:00100000:2.0:1783071433.574370:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665625984 00000100:00100000:2.0:1783071433.574440:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:2.0:1783071433.574453:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:11301:x1869685665625984:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071433.574475:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071433.574508:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaae4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783071433.574530:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783071433.574621:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574638:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574649:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574663:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574669:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574707:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.574999:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575008:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575015:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575020:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071433.575025:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575032:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575045:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071433.575047:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071433.575051:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575066:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575072:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575082:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575086:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071433.575088:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575093:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575099:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9782d9b38200) 00010000:00010000:2.0:1783071433.575101:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071433.575103:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575108:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575133:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7aee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaae4 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575142:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071433.575143:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071433.575146:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaae4 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.575153:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938400, rc 0) 00000100:00100000:2.0:1783071433.575210:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:11301:x1869685665625984:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 762us (932us total) trans 0 rc 301/301 00000100:00100000:2.0:1783071433.575224:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:1.0:1783071433.585131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071433.585237:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665626240 00000100:00100000:3.0:1783071433.585249:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665626240 00000100:00100000:3.0:1783071433.585365:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:3.0:1783071433.585389:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:11301:x1869685665626240:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:3.0:1783071433.585465:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071433.585496:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c13d6a00/0xd360fc6ce6ec746c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca91d expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.585517:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:3.0:1783071433.585523:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071433.585872:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.585888:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.585898:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.585931:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.585946:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 5 pid: 5792 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071433.585960:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684501248:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071433.586050:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779c180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071433.593305:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684501248:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071433.593343:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071433.594416:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071433.594498:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665626368 00000100:00100000:2.0:1783071433.594508:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665626368 00010000:00010000:2.0:1783071433.594569:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 6 pid: 5792 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.594610:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1783071433.594619:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2357:x1869685665626368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071433.594635:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071433.594642:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 6 pid: 5792 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594654:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 6 pid: 5792 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594706:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaad6 expref: 6 pid: 5792 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594721:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:2.0:1783071433.594726:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594736:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594743:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.594774:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071433.594828:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665626368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 209us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071433.594836:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00080000:3.0:1783071433.595015:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783071433.595534:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.595545:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.595570:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.595588:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.595596:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071433.596616:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783071433.596631:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596641:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596649:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596655:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071433.596659:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596667:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596706:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782cd62c100) 00010000:00010000:0.0:1783071433.596710:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071433.596714:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.596721:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b03 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071433.596750:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057b082db reply state 000000008dc1e94b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.596760:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071433.596873:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11301:x1869685665626240:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 11493us (11747us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783071433.596883:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00010000:00010000:3.0:1783071433.605728:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605750:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605759:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605766:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071433.605772:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605780:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605805:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9782cc2b6300) 00010000:00010000:3.0:1783071433.605809:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071433.605814:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.605821:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7b0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.690225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.690599:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665626496 00000100:00100000:1.0:1783071433.690608:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665626496 00000100:00100000:1.0:1783071433.690664:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1783071433.690697:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+14:11309:x1869685665626496:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:1.0:1783071433.690723:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071433.690748:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaeb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690810:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690830:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690840:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071433.690891:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783071433.690893:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071433.690910:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690928:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaeb expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690938:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaeb expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.690944:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071433.690946:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071433.690948:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3e00, rc 0) 00000100:00100000:1.0:1783071433.691000:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11309:x1869685665626496:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 328us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.691007:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:0.0:1783071433.739559:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.739668:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665626624 00000100:00100000:1.0:1783071433.739710:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665626624 00000100:00100000:1.0:1783071433.739754:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:1.0:1783071433.739762:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+15:11315:x1869685665626624:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071433.739781:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071433.739812:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaf2 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739868:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739878:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739887:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739896:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739900:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739904:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739986:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739990:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.739994:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071433.740015:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783071433.740017:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071433.740032:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740045:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740049:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740053:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740057:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071433.740059:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740064:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740072:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071433.740074:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071433.740076:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740080:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740088:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740091:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740095:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740101:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071433.740103:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740106:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740111:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9782c4fab600) 00010000:00010000:1.0:1783071433.740112:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071433.740113:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740116:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740137:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf2 expref: 17 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740145:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf2 expref: 16 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.740149:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071433.740150:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783071433.740151:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071433.740207:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11315:x1869685665626624:12345-192.168.202.16@tcp:101:bash.0 Request processed in 445us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.740214:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:2.0:1783071433.746498:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071433.746784:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665626880 00000100:00100000:3.0:1783071433.746795:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665626880 00000100:00100000:3.0:1783071433.748938:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1783071433.748959:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11315:x1869685665626880:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071433.748981:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071433.749000:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7b3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaaf9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749139:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749151:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749161:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749195:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749203:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749210:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071433.749792:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1783071433.749959:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749969:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.749974:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750001:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750013:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750017:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750021:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071433.750023:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750028:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750037:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071433.750039:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071433.750041:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750045:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7b42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071433.750054:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000661fdec7 reply state 00000000c6354bc2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071433.750060:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783071433.750082:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7b3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750091:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.750103:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:3.0:1783071433.750104:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071433.750106:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071433.750182:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11315:x1869685665626880:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1232us (3699us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1783071433.750194:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00010000:00010000:3.0:1783071433.754009:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.754026:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.754034:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.754040:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071433.754045:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.754053:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.754310:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.754610:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665627008 00000100:00100000:1.0:1783071433.754632:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665627008 00000100:00100000:1.0:1783071433.754725:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1783071433.754733:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665627008:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071433.754748:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071433.754763:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab00 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071433.754782:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071433.754797:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1783071433.754800:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071433.754806:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.754819:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.754829:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3a00, rc 0) 00000100:00100000:1.0:1783071433.754878:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665627008:12345-192.168.202.16@tcp:101:bash.0 Request processed in 147us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.754882:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00080000:0.0:1783071433.754960:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783071433.755335:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9936400) 00010000:00010000:3.0:1783071433.755340:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071433.755346:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071433.755354:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7b49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.758227:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071433.758321:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665627136 00000100:00100000:2.0:1783071433.758332:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665627136 00000100:00100000:2.0:1783071433.758433:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1783071433.758446:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:11315:x1869685665627136:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071433.758466:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071433.758486:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab07 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.758523:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.758533:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071433.758614:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071433.758621:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.758657:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.758708:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 7 pid: 6588 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.758738:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6587:1869685684501376:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071433.758848:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071433.761838:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6587:1869685684501376:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071433.761838:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1783071433.761872:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.761894:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939a00, rc 0) 00000100:00100000:0.0:1783071433.761995:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665627264 00000100:00100000:0.0:1783071433.762002:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665627264 00010000:00010000:0.0:1783071433.762037:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 8 pid: 6588 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.762080:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1783071433.762090:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665627264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071433.762104:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071433.762125:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 8 pid: 6588 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.762136:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 8 pid: 6588 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.762159:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88543b/0xd360fc6ce6ec7b5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab00 expref: 8 pid: 6588 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.762187:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071433.762191:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071433.762199:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.762208:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.762239:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.762253:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5776:1869685684501504:192.168.202.16@tcp:105: 00000100:00100000:2.0:1783071433.762346:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:11315:x1869685665627136:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3903us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071433.762354:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:0.0:1783071433.762455:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4e4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071433.765488:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5776:1869685684501504:192.168.202.16@tcp:105: 00010000:00010000:3.0:1783071433.765524:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071433.765720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.765803:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665627520 00000100:00100000:0.0:1783071433.765810:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665627520 00000100:00100000:0.0:1783071433.765857:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:0.0:1783071433.765867:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11315:x1869685665627520:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1783071433.766159:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11315:x1869685665627520:12345-192.168.202.16@tcp:35:bash.0 Request processed in 294us (440us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783071433.766165:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:3.0:1783071433.766390:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665627264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4300us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071433.766399:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1783071433.843090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071433.843312:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665627776 00000100:00100000:2.0:1783071433.843323:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665627776 00000100:00100000:2.0:1783071433.843396:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:2.0:1783071433.843407:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11325:x1869685665627776:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071433.843432:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071433.843454:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab0e expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071433.843572:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783071433.843715:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7b6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab0e expref: 21 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.843729:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071433.843732:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071433.843752:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab0e expref: 21 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.843765:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939000, rc 0) 00000100:00100000:2.0:1783071433.843829:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11325:x1869685665627776:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 424us (750us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1783071433.843836:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:0.0:1783071433.847610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071433.847763:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628032 00000100:00100000:3.0:1783071433.847774:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628032 00000100:00100000:3.0:1783071433.847832:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:3.0:1783071433.847841:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11325:x1869685665628032:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071433.848108:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11325:x1869685665628032:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 267us (506us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1783071433.848115:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00010000:00010000:1.0:1783071433.888932:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071433.907729:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.907830:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628160 00000100:00100000:1.0:1783071433.907839:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628160 00000100:00100000:1.0:1783071433.907901:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:1.0:1783071433.907926:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11331:x1869685665628160:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071433.907954:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071433.907976:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab15 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908043:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908058:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908070:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071433.908136:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783071433.908140:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071433.908164:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908190:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab15 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908207:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab15 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.908215:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071433.908217:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071433.908220:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3800, rc 0) 00000100:00100000:1.0:1783071433.908296:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11331:x1869685665628160:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 371us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.908311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:1.0:1783071433.913136:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.916659:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628416 00000100:00100000:0.0:1783071433.916708:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628416 00000100:00100000:0.0:1783071433.916793:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:0.0:1783071433.916805:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11331:x1869685665628416:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071433.916827:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071433.916848:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7b88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab1c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.916956:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7b8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.916972:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.916984:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071433.916995:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783071433.917131:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7b88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab1c expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.917150:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab1c expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.917160:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:0.0:1783071433.917163:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071433.917167:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071433.917242:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11331:x1869685665628416:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 439us (4115us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1783071433.917251:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:0.0:1783071433.924640:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.924819:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628672 00000100:00100000:1.0:1783071433.924829:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628672 00000100:00100000:1.0:1783071433.924890:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:1.0:1783071433.924899:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11331:x1869685665628672:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071433.924926:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071433.924946:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab23 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.925046:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.925060:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.925072:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071433.925086:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783071433.925211:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab23 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.925231:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab23 expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.925239:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:1.0:1783071433.925242:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783071433.925263:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3200, rc 0) 00000100:00100000:1.0:1783071433.925329:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11331:x1869685665628672:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 431us (711us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783071433.925336:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1783071433.926765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.926928:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628800 00000100:00100000:0.0:1783071433.926936:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628800 00000100:00100000:0.0:1783071433.926989:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1783071433.926998:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:2355:x1869685665628800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071433.927013:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071433.927035:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab1c expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.927053:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:0.0:1783071433.927058:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071433.927110:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:2355:x1869685665628800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071433.927118:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1783071433.933122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.933224:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665628928 00000100:00100000:1.0:1783071433.933235:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665628928 00000100:00100000:1.0:1783071433.933307:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1783071433.933318:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665628928:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:1.0:1783071433.933383:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.933406:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.933415:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071433.933420:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071433.933424:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.933475:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.933490:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 6 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071433.933507:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6588:1869685684501632:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071433.933605:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783071433.936359:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6588:1869685684501632:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071433.936389:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.937646:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.937801:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629056 00000100:00100000:1.0:1783071433.937808:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629056 00002000:00100000:1.0:1783071433.937849:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9781c727df80 x1869685665629056/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:24/0 lens 504/0 e 0 to 0 dl 1783071444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071433.937861:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c727df80 with x1869685665629056 ext(0->12) 00010000:00010000:1.0:1783071433.937869:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.937884:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 7 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071433.937891:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9781c727df80 00000100:00100000:1.0:1783071433.937919:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1783071433.937927:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665629056:12345-192.168.202.16@tcp:4:lfs.0 00000100:00100000:1.0:1783071433.938391:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665629056:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 462us (749us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783071433.938399:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00002000:00100000:1.0:1783071433.938405:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9781c727df80 x1869685665629056/t4294967305(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:24/0 lens 504/448 e 0 to 0 dl 1783071444 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783071433.938414:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c727df80 with x1869685665629056 ext(0->12) 00010000:00010000:1.0:1783071433.938420:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.938436:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071433.938444:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9781c727df80 00000100:00100000:3.0:1783071433.945633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.946018:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629184 00000100:00100000:0.0:1783071433.946028:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629184 00010000:00010000:1.0:1783071433.946567:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071433.946743:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1783071433.946755:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665629184:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071433.946774:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783071433.946794:0:5776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783071433.946797:0:5776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783071434 00002000:00010000:1.0:1783071433.946800:0:5776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783071434 00002000:00010000:1.0:1783071433.946802:0:5776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783071434 00010000:00010000:1.0:1783071433.946808:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.946822:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.946845:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff6b37d7/0xd360fc6ce6ec7b65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab07 expref: 9 pid: 6587 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.946863:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071433.946881:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071433.946887:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.946899:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.946937:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071433.947002:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665629184:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 248us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.947010:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00010000:00010000:2.0:1783071433.947074:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947084:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947107:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947115:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947123:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947130:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071433.947135:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947155:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947167:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.947175:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82f8c3a/0xd360fc6ce6ec7bb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.947225:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665628928:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 13909us (14115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071433.947233:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1783071433.949805:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.949937:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629440 00000100:00100000:1.0:1783071433.949947:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629440 00000100:00100000:1.0:1783071433.950001:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1783071433.950011:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:11331:x1869685665629440:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:1.0:1783071433.950078:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab23 expref: 25 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071433.950326:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1783071433.950372:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1783071433.951182:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1783071433.951245:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.951276:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.951286:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.951336:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.951352:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 29 pid: 5793 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071433.951367:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684501760:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071433.951785:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3926cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071433.954202:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684501760:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071433.954235:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071433.954413:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684501888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071433.954478:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071433.954565:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684501888 00000100:00100000:0.0:1783071433.954572:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684501888 00000100:00100000:0.0:1783071433.954640:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783071433.954649:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684501888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071433.954696:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071433.954744:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684501888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071433.954750:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783071433.954801:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684501888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783071433.955021:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071433.956601:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071433.956722:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629568 00000100:00100000:1.0:1783071433.956731:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629568 00010000:00010000:1.0:1783071433.956767:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 30 pid: 5793 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071433.956805:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1783071433.956814:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+30:2358:x1869685665629568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071433.956828:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071433.956835:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 30 pid: 5793 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.956848:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 30 pid: 5793 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.956931:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf9 expref: 30 pid: 5793 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.956963:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:1.0:1783071433.956968:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.956978:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.956986:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071433.957021:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071433.957076:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:2358:x1869685665629568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 263us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071433.957084:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00010000:00010000:2.0:1783071433.957177:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071433.957185:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071433.957319:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783071433.957531:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1783071433.957634:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684502016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783071433.957722:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071433.957749:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be000 going to sleep for 11 seconds 00000100:00100000:0.0:1783071433.957817:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502016 00000100:00100000:0.0:1783071433.957823:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502016 00000100:00100000:0.0:1783071433.957863:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071433.957871:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684502016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071433.957949:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684502016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071433.957955:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071433.957995:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684502016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071433.958585:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1783071433.958645:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684502144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071433.958713:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071433.958734:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4e4f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071433.958749:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502144 00000100:00100000:0.0:1783071433.958753:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502144 00000100:00100000:0.0:1783071433.958775:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071433.958781:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1869685684502144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071433.958922:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869685684502144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (208us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783071433.958929:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071433.958963:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684502144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071433.959007:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1783071433.959043:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959053:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959068:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959074:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071433.959078:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959086:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959100:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:0.0:1783071433.959103:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783071433.959108:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.959113:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7bb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071433.959277:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783071433.959374:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1783071433.959384:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335333709417ns, next at 336333707619ns, rc = 0 00000001:00080000:0.0:1783071433.959389:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1783071433.959416:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9936100) 00010000:00010000:0.0:1783071433.959419:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783071433.959425:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7ba4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab23 expref: 33 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071433.959503:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11331:x1869685665629440:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 9495us (9709us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1783071433.959520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000020:00080000:0.0:1783071433.959523:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783071433.962580:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.963005:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629696 00000100:00100000:0.0:1783071433.963015:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629696 00000100:00100000:0.0:1783071433.963078:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:0.0:1783071433.963088:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11331:x1869685665629696:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071433.963114:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071433.963139:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7bc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab2a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.963197:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab2a expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.963211:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab2a expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071433.963230:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071433.963233:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071433.963236:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071433.963301:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:11331:x1869685665629696:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 214us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071433.963308:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:3.0:1783071433.966775:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071433.966883:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665629952 00000100:00100000:0.0:1783071433.966892:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665629952 00000100:00100000:0.0:1783071433.966950:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1783071433.966960:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+33:11331:x1869685665629952:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071433.967212:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11331:x1869685665629952:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 252us (446us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1783071433.967220:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1783071434.037134:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071434.037352:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665630208 00000100:00100000:1.0:1783071434.037363:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665630208 00000100:00100000:1.0:1783071434.037435:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:1.0:1783071434.037444:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11341:x1869685665630208:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071434.037505:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071434.037539:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab31 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071434.037777:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783071434.038016:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7bc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab31 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.038043:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071434.038061:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071434.038085:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab31 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.038100:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3a00, rc 0) 00000100:00100000:1.0:1783071434.038221:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11341:x1869685665630208:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 777us (1098us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1783071434.038230:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:2.0:1783071434.049741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071434.049851:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665630336 00000100:00100000:0.0:1783071434.049860:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665630336 00000100:00100000:0.0:1783071434.049922:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1783071434.049933:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11341:x1869685665630336:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1783071434.050008:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050025:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050039:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050052:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050059:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050064:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050159:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050168:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050186:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071434.050229:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050242:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050248:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050289:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050295:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071434.050300:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050307:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050318:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071434.050321:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071434.050326:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050332:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7bd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050346:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050356:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050361:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050366:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071434.050368:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050373:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050380:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782cc2b6200) 00010000:00010000:0.0:1783071434.050382:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071434.050384:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050390:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050404:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050410:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050415:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050420:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071434.050429:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050436:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050444:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071434.050447:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071434.050449:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.050455:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7be3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071434.050528:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11341:x1869685665630336:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 596us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071434.050536:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:0.0:1783071434.061171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071434.061285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665630592 00000100:00100000:2.0:1783071434.061307:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665630592 00000100:00100000:2.0:1783071434.061367:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:2.0:1783071434.061377:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11341:x1869685665630592:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1783071434.061646:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:11341:x1869685665630592:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 269us (483us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1783071434.061653:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1783071434.109805:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071434.110324:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665630848 00000100:00100000:1.0:1783071434.110334:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665630848 00000100:00100000:1.0:1783071434.110397:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:1.0:1783071434.110407:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:11344:x1869685665630848:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071434.110430:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071434.110449:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7bea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab38 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110518:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110534:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110545:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110559:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110565:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110590:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110754:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110764:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110771:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071434.110781:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783071434.110874:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110882:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110888:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110893:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071434.110897:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110903:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110914:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071434.110916:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071434.110926:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110932:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7bf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110947:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110953:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110958:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110963:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071434.110966:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110972:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110979:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab600) 00010000:00010000:1.0:1783071434.110981:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071434.110984:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.110989:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7bf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.111026:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7bea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.111052:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.111060:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071434.111062:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071434.111064:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2e00, rc 0) 00000100:00100000:1.0:1783071434.111131:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11344:x1869685665630848:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 725us (1335us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783071434.111138:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:3.0:1783071434.123191:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071434.123273:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665630976 00000100:00100000:0.0:1783071434.123283:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665630976 00000100:00100000:0.0:1783071434.123399:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1783071434.123410:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11344:x1869685665630976:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1783071434.123479:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123497:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123509:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123555:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123561:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123568:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123573:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071434.123578:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123584:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123596:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071434.123598:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071434.123603:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.123608:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7c0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071434.123814:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11344:x1869685665630976:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 405us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071434.123824:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1783071434.125622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071434.125811:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665631232 00000100:00100000:3.0:1783071434.125820:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665631232 00000100:00100000:3.0:1783071434.125921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1783071434.125930:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11344:x1869685665631232:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071434.126197:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:11344:x1869685665631232:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 268us (581us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1783071434.126205:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1783071434.404190:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071434.404359:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665631488 00000100:00100000:2.0:1783071434.404369:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665631488 00000100:00100000:2.0:1783071434.404435:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:2.0:1783071434.404446:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:11375:x1869685665631488:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1783071434.404534:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071434.404555:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab3f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.404657:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7c1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.404731:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.404745:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071434.404757:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783071434.405381:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab3f expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.405403:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7c1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab3f expref: 41 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.405425:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071434.405428:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071434.405431:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938400, rc 0) 00000100:00100000:2.0:1783071434.405856:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:11375:x1869685665631488:12345-192.168.202.16@tcp:101:cat.0 Request processed in 1410us (1674us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783071434.405865:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:0.0:1783071434.413766:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071434.413818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071434.413960:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665631616 00000100:00100000:1.0:1783071434.413969:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665631616 00000100:00100000:1.0:1783071434.414037:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1783071434.414047:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:2356:x1869685665631616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071434.414063:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071434.414087:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab3f expref: 41 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.414106:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071434.414111:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071434.414171:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:2356:x1869685665631616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 125us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071434.414179:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1783071434.414539:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665631872 00000100:00100000:2.0:1783071434.414545:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665631872 00000100:00100000:2.0:1783071434.414585:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1783071434.414593:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:11375:x1869685665631872:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1783071434.414858:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:11375:x1869685665631872:12345-192.168.202.16@tcp:35:cat.0 Request processed in 265us (1101us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783071434.414866:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1783071434.464984:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783071434.465005:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684502272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071434.465077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071434.466024:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502272 00000100:00100000:0.0:1783071434.466038:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502272 00000100:00100000:3.0:1783071434.466516:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783071434.466528:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684502272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071434.466567:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071434.466647:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684502272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071434.466654:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1783071434.467265:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071434.467309:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684502272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071434.467572:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684502528:0@lo:400:kworker.0 00000100:00100000:1.0:1783071434.467759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071434.467813:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071434.467819:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684502656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071434.467844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071434.467914:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502528 00000100:00100000:2.0:1783071434.467920:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502528 00000100:00100000:2.0:1783071434.467970:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502656 00000100:00100000:2.0:1783071434.467983:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502656 00000100:00100000:2.0:1783071434.468011:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783071434.468019:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684502528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071434.468066:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684502528:12345-0@lo:400:kworker.0 Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071434.468080:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783071434.468096:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783071434.468103:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684502656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071434.468136:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684502656:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071434.468142:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1783071434.468159:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071434.468516:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684502656:0@lo:400:kworker.0 00000100:00100000:1.0:1783071434.468528:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684502528:0@lo:400:kworker.0 00000100:00100000:0.0:1783071434.468610:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684502784:0@lo:400:kworker.0 00000100:00100000:0.0:1783071434.468656:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071434.468714:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071434.468721:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684502400:0@lo:400:kworker.0 00000100:00100000:0.0:1783071434.468750:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071434.468786:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502784 00000100:00100000:0.0:1783071434.468790:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502784 00000100:00100000:0.0:1783071434.468823:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783071434.468829:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684502784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071434.468866:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684502784:12345-0@lo:400:kworker.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071434.468872:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1783071434.468887:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071434.468902:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684502784:0@lo:400:kworker.0 00000100:00100000:1.0:1783071434.469085:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684502400 00000100:00100000:1.0:1783071434.469090:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684502400 00000100:00100000:1.0:1783071434.469126:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783071434.469133:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684502400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071434.470282:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684502400:12345-0@lo:400:kworker.0 Request processed in 1145us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071434.470291:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783071434.470772:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684502400:0@lo:400:kworker.0 00000100:00100000:0.0:1783071434.505438:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071434.511173:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665632128 00000100:00100000:1.0:1783071434.511188:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665632128 00000100:00100000:1.0:1783071434.511317:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:1.0:1783071434.511327:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:11381:x1869685665632128:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1783071434.511353:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071434.511357:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783071434.511383:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7b81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab15 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511404:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071434.511408:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071434.511421:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7c29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab46 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511534:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511561:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511569:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511603:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.511616:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 41 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071434.511641:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684502912:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071434.511778:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c53f1840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071434.514715:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684502912:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071434.514745:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071434.520248:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071434.520348:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665632256 00000100:00100000:3.0:1783071434.520360:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665632256 00010000:00010000:3.0:1783071434.520402:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 42 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071434.520441:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1783071434.520458:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+42:2358:x1869685665632256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071434.520473:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071434.520480:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 42 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520492:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 42 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520514:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab38 expref: 42 pid: 5791 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520550:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:3.0:1783071434.520555:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520565:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520572:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.520605:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071434.520710:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:2358:x1869685665632256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 215us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071434.520719:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00010000:00010000:2.0:1783071434.520901:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.520910:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071434.520933:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783071434.521094:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3c00/0xd360fc6ce6ec7c29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.521110:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.521117:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071434.521119:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071434.521122:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2800, rc 0) 00000100:00100000:2.0:1783071434.521161:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:11381:x1869685665632128:12345-192.168.202.16@tcp:101:dd.0 Request processed in 9835us (15736us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1783071434.521168:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:0.0:1783071434.527333:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071434.527420:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665632512 00000100:00100000:2.0:1783071434.527456:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665632512 00000100:00100000:2.0:1783071434.527523:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:2.0:1783071434.527534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+41:11381:x1869685665632512:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:2.0:1783071434.527862:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.527880:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.527891:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071434.527947:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1783071434.527970:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062651481 reply state 0000000048f6941c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071434.527979:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071434.528059:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+44:11381:x1869685665632512:12345-192.168.202.16@tcp:36:dd.0 Request processed in 526us (736us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783071434.528065:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 155 00000020:00080000:2.0:1783071434.528070:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071434.530900:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530916:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530923:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530930:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071434.530935:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530956:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530974:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071434.530977:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071434.530981:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.530988:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071434.765096:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071434.765911:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665632640 00000100:00100000:2.0:1783071434.765922:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665632640 00000100:00100000:2.0:1783071434.766040:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:2.0:1783071434.766051:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:11396:x1869685665632640:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:2.0:1783071434.766075:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071434.766094:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab4d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766179:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766195:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766208:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766221:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766239:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766259:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766357:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766368:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766390:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766422:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.766436:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 44 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071434.766463:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684503040:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071434.766562:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40beb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071434.768813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071434.768848:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665632896 00000100:00100000:3.0:1783071434.768857:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665632896 00000100:00100000:3.0:1783071434.768908:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1783071434.768918:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:6028:x1869685665632896:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071434.769242:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:6028:x1869685665632896:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 325us (438us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1783071434.769266:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1783071434.769600:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684503040:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071434.769636:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071434.771865:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071434.771961:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665633024 00000100:00100000:3.0:1783071434.771969:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665633024 00010000:00010000:3.0:1783071434.772009:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 46 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071434.772059:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:3.0:1783071434.772069:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:2358:x1869685665633024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071434.772087:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071434.772094:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 46 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772107:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 46 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772131:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec7c30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab46 expref: 46 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772148:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:3.0:1783071434.772154:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772164:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772172:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071434.772299:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071434.772355:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:2358:x1869685665633024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 286us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071434.772363:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00010000:00010000:2.0:1783071434.774092:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774109:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071434.774189:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783071434.774194:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071434.774222:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774239:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774261:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774268:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774276:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774282:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071434.774287:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774294:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774307:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071434.774311:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071434.774315:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774321:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7c4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774351:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774356:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774362:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774367:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071434.774370:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774604:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774614:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9b38700) 00010000:00010000:2.0:1783071434.774617:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071434.774749:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774757:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774807:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab4d expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774821:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab4d expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.774841:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071434.774843:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071434.774846:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:2.0:1783071434.774967:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+44:11396:x1869685665632640:12345-192.168.202.16@tcp:101:stat.0 Request processed in 8917us (9879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071434.774976:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:0.0:1783071434.831744:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071434.831840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665633280 00000100:00100000:2.0:1783071434.831850:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665633280 00000100:00100000:2.0:1783071434.831913:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:2.0:1783071434.831924:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+44:11402:x1869685665633280:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:2.0:1783071434.831986:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071434.832013:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab4d expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.832031:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071434.832036:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071434.832240:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.832268:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071434.832278:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071434.832327:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1783071434.832349:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bffe08a7 reply state 00000000943082af transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071434.832388:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071434.832489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:11402:x1869685665633280:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 567us (754us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783071434.832497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 157 00000020:00080000:2.0:1783071434.832502:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783071434.834781:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834797:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834806:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834813:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071434.834818:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834826:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834841:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071434.834844:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071434.834848:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.834854:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7c61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071434.912912:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071434.971801:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071434.971907:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665633408 00000100:00100000:1.0:1783071434.971917:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665633408 00000100:00100000:1.0:1783071434.971978:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:1.0:1783071434.971988:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+45:11416:x1869685665633408:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:1.0:1783071434.972013:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071434.972034:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7c68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab54 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972121:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972144:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972156:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972173:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972180:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972187:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972300:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972309:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972316:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071434.972352:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783071434.972357:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071434.972377:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972388:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972407:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972413:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972419:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972424:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071434.972428:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972436:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972448:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071434.972451:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071434.972456:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972462:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7c6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972475:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972480:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972485:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972497:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071434.972501:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972521:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972646:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab600) 00010000:00010000:1.0:1783071434.972650:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071434.972653:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972660:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7c76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972734:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7c68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972748:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 46 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071434.972756:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071434.972758:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071434.972760:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2600, rc 0) 00000100:00100000:1.0:1783071434.972825:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:11416:x1869685665633408:12345-192.168.202.16@tcp:101:stat.0 Request processed in 837us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071434.972833:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 158 00000001:00080000:2.0:1783071435.024347:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1783071435.024902:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1783071435.044215:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.044337:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665633664 00000100:00100000:2.0:1783071435.044346:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665633664 00000100:00100000:2.0:1783071435.044535:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:2.0:1783071435.044549:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+46:11426:x1869685665633664:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071435.044584:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.044605:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab5b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.044761:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783071435.044886:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab5b expref: 48 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.044901:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071435.044904:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071435.044909:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab5b expref: 48 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.044924:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:2.0:1783071435.044981:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:11426:x1869685665633664:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 436us (777us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1783071435.045000:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00080000:0.0:1783071435.045292:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071435.048662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.048767:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665633920 00000100:00100000:2.0:1783071435.048781:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665633920 00000100:00100000:2.0:1783071435.048847:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1783071435.048858:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:11426:x1869685665633920:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1783071435.049104:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+48:11426:x1869685665633920:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 249us (450us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783071435.049113:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1783071435.118343:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.119814:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665634176 00000100:00100000:2.0:1783071435.119994:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665634176 00000100:00100000:2.0:1783071435.120135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:2.0:1783071435.120148:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+48:11432:x1869685665634176:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071435.120175:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.120197:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab62 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.120319:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.120334:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.120343:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.120390:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.120423:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 49 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.120611:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684503168:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071435.120932:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071435.123355:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684503168:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071435.123383:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.125914:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.126135:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665634304 00000100:00100000:1.0:1783071435.126158:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665634304 00010000:00010000:1.0:1783071435.126203:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 50 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.126257:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1783071435.126268:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:2358:x1869685665634304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071435.126283:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071435.126290:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 50 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126304:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 50 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126326:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7c7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab54 expref: 50 pid: 5791 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126342:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071435.126348:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126356:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126364:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.126394:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071435.126540:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.126548:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.126578:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783071435.126767:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec7c92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.126783:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.126791:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071435.126794:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071435.126796:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938e00, rc 0) 00000100:00100000:1.0:1783071435.127120:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:2358:x1869685665634304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 852us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.127140:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1783071435.127188:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:11432:x1869685665634176:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7044us (8853us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1783071435.127205:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:3.0:1783071435.133303:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.133411:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665634560 00000100:00100000:1.0:1783071435.133421:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665634560 00000100:00100000:1.0:1783071435.133539:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:1.0:1783071435.133551:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+49:11432:x1869685665634560:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:1.0:1783071435.134163:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.134181:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.134193:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071435.134257:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1783071435.134284:0:6976:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000104e613f reply state 000000002edf9b55 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.134293:0:6976:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071435.134387:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11432:x1869685665634560:12345-192.168.202.16@tcp:36:bash.0 Request processed in 836us (1094us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1783071435.134396:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00000020:00080000:1.0:1783071435.134402:0:6976:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071435.137868:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137886:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137894:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137899:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.137904:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137911:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137927:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071435.137930:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.137934:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.137940:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7ca7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.142262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.143077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665634688 00000100:00100000:1.0:1783071435.143089:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665634688 00000100:00100000:1.0:1783071435.143182:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:1.0:1783071435.143193:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:11432:x1869685665634688:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071435.143217:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.143260:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab69 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.143340:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.143354:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 52 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.143363:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.143592:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 52 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.143606:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 52 pid: 5792 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.143802:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684503296:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071435.144005:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071435.146235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.146338:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665634816 00000100:00100000:0.0:1783071435.146347:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665634816 00010000:00010000:0.0:1783071435.146391:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 53 pid: 5792 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.146464:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1783071435.146475:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:2358:x1869685665634816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071435.146489:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071435.146496:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 53 pid: 5792 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.146508:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 53 pid: 5792 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.146530:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071435.146536:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.146545:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.146552:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.146581:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071435.146646:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:2358:x1869685665634816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 173us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.146653:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00010000:00010000:1.0:1783071435.148208:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938e00/0xd360fc6ce6ec7c99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab62 expref: 52 pid: 5792 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.148230:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684503296:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071435.148265:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.148274:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.148295:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071435.149140:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783071435.149147:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071435.149171:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.149206:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab69 expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.149223:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab69 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.149232:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071435.149235:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071435.149238:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2200, rc 0) 00000100:00100000:1.0:1783071435.149317:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:11432:x1869685665634688:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6125us (7070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.149325:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:3.0:1783071435.155093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.155315:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665635072 00000100:00100000:2.0:1783071435.155325:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665635072 00000100:00100000:2.0:1783071435.155385:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:2.0:1783071435.155395:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:11432:x1869685665635072:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:2.0:1783071435.156099:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11432:x1869685665635072:12345-192.168.202.16@tcp:35:bash.0 Request processed in 703us (1014us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1783071435.156119:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1783071435.241794:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.242990:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665635328 00000100:00100000:2.0:1783071435.243002:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665635328 00000100:00100000:2.0:1783071435.243071:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:2.0:1783071435.243082:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11442:x1869685665635328:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071435.243110:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.243132:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab70 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.243271:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783071435.243382:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cbc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab70 expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.243398:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071435.243402:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071435.243406:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab70 expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.243422:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071435.243501:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:11442:x1869685665635328:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 421us (1717us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1783071435.243508:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:0.0:1783071435.252583:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.252987:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665635456 00000100:00100000:2.0:1783071435.252998:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665635456 00000100:00100000:2.0:1783071435.253061:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:2.0:1783071435.253071:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:11442:x1869685665635456:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1783071435.253162:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253317:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253331:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253350:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253358:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253364:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253528:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253537:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253544:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071435.253589:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253602:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253618:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253625:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253631:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.253636:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253643:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253656:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071435.253659:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.253664:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253670:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253721:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253726:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253731:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253735:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.253744:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253750:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253758:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9b38700) 00010000:00010000:2.0:1783071435.253761:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.253763:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253769:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253783:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253789:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253795:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253800:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.253803:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.253809:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.254001:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071435.254005:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.254015:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.254022:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.254167:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:11442:x1869685665635456:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 1096us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.254185:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:3.0:1783071435.262016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.262285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665635712 00000100:00100000:2.0:1783071435.262296:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665635712 00000100:00100000:2.0:1783071435.262360:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:2.0:1783071435.262739:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+53:11442:x1869685665635712:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1783071435.263054:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11442:x1869685665635712:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 684us (1049us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1783071435.263063:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1783071435.310829:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.310930:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665635968 00000100:00100000:2.0:1783071435.310941:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665635968 00000100:00100000:2.0:1783071435.311005:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:2.0:1783071435.311015:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11445:x1869685665635968:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071435.311040:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.311059:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab77 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311131:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311145:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311176:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311193:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311199:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311205:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311348:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7cf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311359:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311366:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.311377:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783071435.311483:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311491:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311499:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311504:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.311514:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311523:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311535:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071435.311538:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.311542:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311548:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7ce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311561:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311567:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311572:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311577:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.311580:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311585:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311592:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9b38700) 00010000:00010000:2.0:1783071435.311594:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.311603:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311609:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7ced lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311650:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7cdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab77 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311663:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab77 expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.311671:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:2.0:1783071435.311725:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071435.311728:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938000, rc 0) 00000100:00100000:2.0:1783071435.311795:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:11445:x1869685665635968:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 781us (976us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783071435.311802:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:0.0:1783071435.316163:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.316280:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665636096 00000100:00100000:1.0:1783071435.316291:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665636096 00000100:00100000:1.0:1783071435.316350:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:1.0:1783071435.316360:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:11445:x1869685665636096:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1783071435.316428:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316444:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316478:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316504:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316510:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316517:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316522:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071435.316527:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316534:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316547:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071435.316550:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071435.316555:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.316561:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.316633:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:11445:x1869685665636096:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 273us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.316640:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:3.0:1783071435.319513:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071435.319571:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.319729:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665636480 00000100:00100000:1.0:1783071435.319750:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665636480 00000100:00100000:0.0:1783071435.319782:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665636352 00000100:00100000:0.0:1783071435.319787:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665636352 00000100:00100000:1.0:1783071435.319805:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1783071435.319829:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:2356:x1869685665636480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783071435.319830:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:0.0:1783071435.319836:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:11445:x1869685665636352:12345-192.168.202.16@tcp:35:lfs.0 00010000:00010000:1.0:1783071435.319846:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071435.319871:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7cf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab77 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.319889:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071435.319894:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071435.319945:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:2356:x1869685665636480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 131us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.319951:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1783071435.320014:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:11445:x1869685665636352:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 177us (510us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1783071435.320021:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1783071435.478639:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.479046:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665636736 00000100:00100000:1.0:1783071435.479059:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665636736 00000100:00100000:1.0:1783071435.479179:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:1.0:1783071435.479189:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:11463:x1869685665636736:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1783071435.479214:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.479235:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab7e expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.479354:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.479372:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.479384:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071435.479419:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783071435.479557:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab7e expref: 59 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.479577:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab7e expref: 58 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.479585:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:1.0:1783071435.479588:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783071435.479592:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2400, rc 0) 00000100:00100000:1.0:1783071435.479654:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11463:x1869685665636736:12345-192.168.202.16@tcp:101:cat.0 Request processed in 467us (1027us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1783071435.479662:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:3.0:1783071435.518220:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.518394:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665636864 00000100:00100000:2.0:1783071435.518416:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665636864 00000100:00100000:2.0:1783071435.518653:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:2.0:1783071435.518666:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11464:x1869685665636864:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071435.518719:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.518742:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab85 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.518814:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.518845:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.518858:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.519031:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783071435.519036:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071435.519121:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.519151:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab85 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.519170:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab85 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.519178:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071435.519181:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071435.519184:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071435.519264:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11464:x1869685665636864:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 600us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.519273:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:1.0:1783071435.534112:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.534149:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665637248 00000100:00100000:1.0:1783071435.534158:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665637248 00000100:00100000:1.0:1783071435.534208:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:1.0:1783071435.534219:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11464:x1869685665637248:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071435.534863:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11464:x1869685665637248:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 643us (760us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783071435.534874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000001:00080000:2.0:1783071435.541723:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1783071435.541742:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783071435.541764:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782c4e4fe40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783071435.541769:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c66b2500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782c4e4fc00 00000020:00080000:2.0:1783071435.541772:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c66b2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9782fa808800 00000020:00080000:1.0:1783071435.541829:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1783071435.542007:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783071435.542163:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071435.542185:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684503424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783071435.542270:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071435.542343:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684503424 00000100:00100000:0.0:1783071435.542351:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684503424 00000100:00100000:0.0:1783071435.542419:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783071435.542429:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684503424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783071435.542734:0:8704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1783071435.542769:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4782ca, atime: 0x6a4782ca, ctime: 0x6a4782ca, blocks: 0xb 00010000:00010000:0.0:1783071435.542778:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.542795:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1783071435.542800:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071435.542805:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.542822:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.542833:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.542851:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.542865:0:8704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783071435.543396:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1869685684503424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 966us (1124us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783071435.543415:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000001:00080000:2.0:1783071435.543568:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00010000:00010000:1.0:1783071435.543769:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071435.543777:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.543800:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071435.543804:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.543814:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.543833:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.543841:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7d2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.543859:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071435.543862:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071435.543863:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071435.544327:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1783071435.544453:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071435.544502:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1783071435.544509:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1783071435.544539:0:3292:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9782fa785180 x1869685684503424/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783071451 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783071435.544552:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782fa785180/2, rc 0, transno 4294967307 00000100:00100000:0.0:1783071435.544570:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684503424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783071435.544994:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665637376 00000100:00100000:1.0:1783071435.545003:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665637376 00000100:00100000:0.0:1783071435.545120:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1783071435.545130:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11464:x1869685665637376:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:0.0:1783071435.545146:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783071435.545168:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7cb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab69 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.545187:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab7e expref: 18 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.545200:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7bc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab2a expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.545221:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6300) 00010000:00010000:0.0:1783071435.545233:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071435.545383:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11464:x1869685665637376:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 254us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.545391:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1783071435.549160:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.549274:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665637504 00000100:00100000:2.0:1783071435.549285:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665637504 00000100:00100000:2.0:1783071435.549383:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:2.0:1783071435.549394:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11464:x1869685665637504:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:2.0:1783071435.549551:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.549579:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.549591:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071435.549960:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783071435.550081:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11464:x1869685665637504:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 686us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.550091:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000040:00080000:0.0:1783071435.552851:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071435.552860:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071435.552900:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1783071435.552914:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071435.553035:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684503552:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071435.553129:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb2873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071435.558754:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9be1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684503552:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783071435.560426:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.560633:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665637632 00000100:00100000:1.0:1783071435.560641:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665637632 00000100:00100000:1.0:1783071435.560746:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:1.0:1783071435.560756:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11465:x1869685665637632:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783071435.560791:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783071435.560904:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11465:x1869685665637632:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 148us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.560928:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:1.0:1783071435.565108:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.565213:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665637760 00000100:00100000:2.0:1783071435.565223:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665637760 00000100:00100000:2.0:1783071435.565302:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:2.0:1783071435.565313:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11465:x1869685665637760:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783071435.565394:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565423:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565443:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565648:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565656:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565663:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565734:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565743:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565748:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071435.565783:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783071435.565787:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071435.565798:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565807:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565813:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565819:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565835:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.565839:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565847:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565859:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:2.0:1783071435.565862:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.565867:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565873:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565887:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565893:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565898:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565902:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.565905:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565910:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565928:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9782d9b38700) 00010000:00010000:2.0:1783071435.565931:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.565933:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565938:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d41 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565953:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565958:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565963:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565968:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.565970:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565975:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565982:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071435.565984:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.565987:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.565992:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7d48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.566081:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11465:x1869685665637760:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 769us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.566089:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:3.0:1783071435.572104:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.572298:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638016 00000100:00100000:1.0:1783071435.572311:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638016 00000100:00100000:1.0:1783071435.572367:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1783071435.572377:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+16:11465:x1869685665638016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071435.572401:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.572427:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7d4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab8c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572520:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572535:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572545:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071435.572557:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783071435.572661:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572669:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572713:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572720:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071435.572738:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572746:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572758:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:1.0:1783071435.572762:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071435.572765:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572772:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec7d56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572809:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7d4f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab8c expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572818:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:1.0:1783071435.572820:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071435.572824:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2a00/0xd360fc6ce6ec7d4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab8c expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.572833:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2a00, rc 0) 00000100:00100000:1.0:1783071435.572898:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11465:x1869685665638016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 521us (803us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1783071435.572906:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:3.0:1783071435.576793:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.576875:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638144 00000100:00100000:2.0:1783071435.576885:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638144 00000100:00100000:2.0:1783071435.576950:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:2.0:1783071435.576961:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11465:x1869685665638144:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071435.576999:0:6976:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071435.577112:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11465:x1869685665638144:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 151us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.577119:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:0.0:1783071435.579846:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.579895:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638272 00000100:00100000:1.0:1783071435.579905:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638272 00000100:00100000:1.0:1783071435.580000:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:1.0:1783071435.580010:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11467:x1869685665638272:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071435.580046:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.580070:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7d64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580133:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580146:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580157:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580170:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580177:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.580183:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581133:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581147:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581155:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071435.581197:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783071435.581210:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071435.581231:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581253:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581263:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581269:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581276:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581281:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071435.581285:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581292:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581302:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071435.581305:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071435.581310:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581317:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581330:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581345:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581351:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581356:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071435.581360:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581367:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581556:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab800) 00010000:00010000:1.0:1783071435.581560:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071435.581564:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581571:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7d72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581613:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7d64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581628:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.581635:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:1.0:1783071435.581637:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071435.581646:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2000, rc 0) 00000100:00100000:0.0:1783071435.581895:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11467:x1869685665638272:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1884us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.581907:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:3.0:1783071435.584639:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.584840:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638528 00000100:00100000:2.0:1783071435.584851:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638528 00000100:00100000:2.0:1783071435.584908:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:2.0:1783071435.584917:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665638528:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071435.584938:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071435.584941:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783071435.584966:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab85 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.584986:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071435.584990:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071435.585003:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcab9a expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071435.585802:0:6976:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783071435.586062:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.586077:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.586088:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.586153:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec7d80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab9a expref: 20 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.586172:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab9a expref: 19 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.586181:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782d9b38700) 00010000:00010000:2.0:1783071435.586184:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071435.586187:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:2.0:1783071435.586293:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11465:x1869685665638528:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1375us (1663us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1783071435.586302:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:2.0:1783071435.589561:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.589658:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638784 00000100:00100000:0.0:1783071435.589669:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638784 00000100:00100000:0.0:1783071435.589824:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:0.0:1783071435.589835:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11465:x1869685665638784:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.589893:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071435.589922:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab9a expref: 19 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.589961:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782d9b38700) 00010000:00010000:0.0:1783071435.589972:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071435.589993:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590006:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590017:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590032:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590040:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590047:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590305:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590313:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590320:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590325:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071435.590329:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590341:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590350:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071435.590353:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071435.590356:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590362:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7d95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590371:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590392:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590398:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590403:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071435.590406:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590411:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590417:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xafbb0bd (ffff9782cc2b6300) 00010000:00010000:0.0:1783071435.590420:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071435.590423:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.590438:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7d9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xafbb0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.590522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665638784:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 688us (970us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783071435.590529:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:0.0:1783071435.592857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.592940:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665638912 00000100:00100000:1.0:1783071435.592950:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665638912 00000100:00100000:1.0:1783071435.593006:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:1.0:1783071435.593015:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665638912:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071435.593036:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.593058:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7da3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaba1 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593091:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593104:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593115:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593210:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 20 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593229:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 19 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.593237:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:1.0:1783071435.593251:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071435.593254:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3400, rc 0) 00000100:00100000:1.0:1783071435.593324:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11465:x1869685665638912:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 309us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.593340:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:3.0:1783071435.607739:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.607801:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665639168 00000100:00100000:0.0:1783071435.607811:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665639168 00000100:00100000:0.0:1783071435.607877:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:0.0:1783071435.607890:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11465:x1869685665639168:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.607971:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.607990:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.608002:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071435.608327:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1783071435.608338:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336982663751ns, next at 337982661476ns, rc = 0 00000004:00010000:0.0:1783071435.608444:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091e99aae reply state 000000001bb0af1b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.608454:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071435.608599:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11465:x1869685665639168:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 710us (869us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1783071435.608620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 178 00010000:00010000:0.0:1783071435.610775:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610791:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610799:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610805:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071435.610809:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610816:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610833:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:0.0:1783071435.610836:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783071435.610840:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.610847:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7db1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.611237:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.615480:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665639296 00000100:00100000:1.0:1783071435.615497:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665639296 00000100:00100000:1.0:1783071435.615580:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:1.0:1783071435.615592:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11465:x1869685665639296:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071435.615920:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.615942:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaba8 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.616002:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 21 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.616033:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 21 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.616061:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:1.0:1783071435.616064:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071435.616067:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3800, rc 0) 00000100:00100000:1.0:1783071435.616138:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11465:x1869685665639296:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 548us (4904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.616145:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:3.0:1783071435.618888:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.619212:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665639424 00000100:00100000:2.0:1783071435.619223:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665639424 00000100:00100000:2.0:1783071435.619311:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:2.0:1783071435.619322:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665639424:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783071435.619511:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071435.619748:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665639424:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 427us (867us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783071435.619756:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1783071435.634906:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.635233:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665639680 00000100:00100000:2.0:1783071435.635253:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665639680 00000100:00100000:2.0:1783071435.635369:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1783071435.635381:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11465:x1869685665639680:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783071435.635647:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11465:x1869685665639680:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 267us (751us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783071435.635656:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1783071435.644071:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.644180:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665639936 00000100:00100000:0.0:1783071435.644191:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665639936 00000100:00100000:0.0:1783071435.644274:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1783071435.644285:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11465:x1869685665639936:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071435.644448:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11465:x1869685665639936:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 164us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.644456:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:3.0:1783071435.647005:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.647114:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640064 00000100:00100000:0.0:1783071435.647123:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640064 00000100:00100000:0.0:1783071435.647171:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:0.0:1783071435.647179:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11465:x1869685665640064:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.647199:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071435.647219:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7dbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabaf expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647296:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647311:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647323:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071435.647363:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071435.647391:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647415:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7dbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabaf expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647435:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabaf expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.647462:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:0.0:1783071435.647465:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783071435.647469:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9c00, rc 0) 00000100:00100000:0.0:1783071435.647571:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11465:x1869685665640064:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 392us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.647578:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:1.0:1783071435.658203:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.658352:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640192 00000100:00100000:0.0:1783071435.658364:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640192 00000100:00100000:0.0:1783071435.658469:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1783071435.658480:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665640192:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.658498:0:8704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071435.658522:0:8704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabb6 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071435.658549:0:8704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4782cc, blocks: 0x1 00010000:00010000:0.0:1783071435.658570:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1783071435.658575:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071435.658584:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 8 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.658604:0:8704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 8 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.658617:0:8704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9800, rc 0) 00000100:00100000:0.0:1783071435.658705:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665640192:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 226us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.658726:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1783071435.667823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.667942:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640448 00000100:00100000:0.0:1783071435.667953:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640448 00000100:00100000:0.0:1783071435.668020:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:0.0:1783071435.668030:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11465:x1869685665640448:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783071435.668147:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11465:x1869685665640448:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.668155:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 182 00000100:00100000:2.0:1783071435.679551:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.679658:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640576 00000100:00100000:1.0:1783071435.679669:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640576 00000100:00100000:1.0:1783071435.679770:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1783071435.679782:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:11465:x1869685665640576:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071435.679809:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071435.679828:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabbd expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.679860:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.679870:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071435.679874:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071435.679879:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.679915:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.679930:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.679944:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6585:1869685684503680:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071435.680044:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c63accc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071435.685774:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6585:1869685684503680:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071435.685811:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.685834:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2600, rc 0) 00000100:00100000:2.0:1783071435.685895:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:11465:x1869685665640576:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 6115us (6356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071435.685904:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1783071435.697094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.697198:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640704 00000100:00100000:0.0:1783071435.697209:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640704 00010000:00010000:0.0:1783071435.697256:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.697303:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1783071435.697314:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665640704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071435.697330:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071435.697354:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.697368:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.697405:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec7dcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabb6 expref: 9 pid: 8704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.697504:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071435.697510:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071435.697520:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.697530:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.697571:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.697585:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684503808:192.168.202.16@tcp:105: 00000100:00100000:0.0:1783071435.697707:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071435.708093:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684503808:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071435.708120:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071435.708180:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665640704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 10867us (11096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.708191:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:2.0:1783071435.710759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071435.710874:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640832 00000100:00100000:3.0:1783071435.710883:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640832 00002000:00100000:3.0:1783071435.710930:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9781c727fb80 x1869685665640832/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:26/0 lens 504/0 e 0 to 0 dl 1783071446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783071435.710957:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c727fb80 with x1869685665640832 ext(0->8) 00002000:00010000:3.0:1783071435.710963:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c727fb80 00000100:00100000:3.0:1783071435.710999:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1783071435.711009:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665640832:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783071435.711570:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2357:x1869685665640832:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 559us (816us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783071435.711580:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00002000:00100000:3.0:1783071435.711587:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9781c727fb80 x1869685665640832/t4294967314(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:26/0 lens 504/448 e 0 to 0 dl 1783071446 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783071435.711595:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c727fb80 with x1869685665640832 ext(0->8) 00002000:00010000:3.0:1783071435.711600:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c727fb80 00000100:00100000:0.0:1783071435.720749:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.725399:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.725433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.725469:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641216 00000100:00100000:0.0:1783071435.725478:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641216 00000100:00100000:0.0:1783071435.725535:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:0.0:1783071435.725543:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665641216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071435.725623:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2355:x1869685665641216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.725631:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:0.0:1783071435.725656:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641088 00000100:00100000:0.0:1783071435.725660:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641088 00000100:00100000:0.0:1783071435.725701:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:0.0:1783071435.725708:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665641088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071435.725733:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c85d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2355:x1869685665641088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.725740:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1783071435.725996:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665640960 00000100:00100000:3.0:1783071435.726001:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665640960 00000100:00100000:3.0:1783071435.726071:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:3.0:1783071435.726078:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665640960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071435.726105:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2355:x1869685665640960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071435.726111:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 283 00000100:00100000:0.0:1783071435.726643:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1783071435.726713:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071435.726718:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071435.726734:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641344 00000100:00100000:0.0:1783071435.726738:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641344 00000100:00100000:0.0:1783071435.726767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1783071435.726774:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11465:x1869685665641344:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783071435.789181:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1783071435.789195:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1783071435.789215:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1783071435.789225:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1783071435.789565:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1783071435.789581:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783071435.789626:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071435.789648:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684503936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783071435.789747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071435.789956:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684503936 00000100:00100000:1.0:1783071435.789964:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684503936 00000100:00100000:1.0:1783071435.790017:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783071435.790027:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684503936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783071435.790196:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783071435.790200:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783071436 00002000:00010000:1.0:1783071435.790202:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783071435.790204:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783071436 -> 1783071436 00002000:00010000:1.0:1783071435.790206:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783071435.790264:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1869685684503936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (516us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783071435.790272:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1783071435.790313:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782faa0e680/2, rc 0, transno 4294967315 00000100:00100000:1.0:1783071435.790319:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684503936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783071435.790911:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665641344:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 64133us (64266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.790920:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 183 00000100:00100000:0.0:1783071435.799301:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071435.800821:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641472 00000100:00100000:3.0:1783071435.800834:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641472 00000100:00100000:3.0:1783071435.800909:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:3.0:1783071435.800920:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2358:x1869685665641472:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783071435.847146:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2358:x1869685665641472:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 46216us (47843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071435.847159:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000001:00080000:3.0:1783071435.847194:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1783071435.847204:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1783071435.847209:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1783071435.849746:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.849822:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641728 00000100:00100000:2.0:1783071435.849851:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641728 00000100:00100000:2.0:1783071435.849911:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 184 00000100:00100000:2.0:1783071435.849923:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665641728:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071435.849985:0:6976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071435.850014:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabaf expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.850035:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:2.0:1783071435.850040:0:6976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071435.850067:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.850081:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.850091:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071435.850359:0:6976:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f50506ff reply state 000000002ce4b10d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.850369:0:6976:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071435.851290:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11465:x1869685665641728:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1366us (1553us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1783071435.851300:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 184 00010000:00010000:3.0:1783071435.854589:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854606:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854613:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854628:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071435.854633:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854640:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854658:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:3.0:1783071435.854661:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071435.854667:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.854690:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec7ddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.855210:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.855258:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665641856 00000100:00100000:0.0:1783071435.855268:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665641856 00000100:00100000:0.0:1783071435.855320:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1783071435.855331:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665641856:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783071435.855655:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783071435.855659:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783071436 -> 1783071435 00002000:00010000:0.0:1783071435.855661:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783071434 00002000:00010000:0.0:1783071435.855663:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783071436 -> 1783071435 00002000:00010000:0.0:1783071435.855665:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783071435.855744:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665641856:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 414us (540us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783071435.855752:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1783071435.858356:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071435.858478:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642112 00000100:00100000:2.0:1783071435.858486:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642112 00000100:00100000:2.0:1783071435.858566:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:2.0:1783071435.858575:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11465:x1869685665642112:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783071435.858663:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.858714:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 18 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.858724:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.858755:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 18 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.858768:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 18 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.858782:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684504064:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071435.858863:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071435.861443:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684504064:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071435.861475:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.862011:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.862079:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642240 00000100:00100000:1.0:1783071435.862086:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642240 00010000:00010000:1.0:1783071435.862123:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071435.862161:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:1.0:1783071435.862171:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:2358:x1869685665642240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071435.862185:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071435.862192:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862203:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862224:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7daa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba1 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862270:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:1.0:1783071435.862274:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862283:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862290:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.862312:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071435.862359:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:2358:x1869685665642240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 189us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071435.862368:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00010000:00010000:2.0:1783071435.862582:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862591:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862622:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862641:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862648:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862654:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.862659:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862667:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862707:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:2.0:1783071435.862710:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783071435.862713:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.862720:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7de2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.862768:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11465:x1869685665642112:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 4193us (4419us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783071435.862776:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 185 00000100:00100000:3.0:1783071435.865547:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.865994:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642368 00000100:00100000:0.0:1783071435.866002:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642368 00000100:00100000:0.0:1783071435.866047:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1783071435.866056:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665642368:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.866099:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.866115:0:8704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.866122:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071435.866125:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071435.866128:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.866155:0:8704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.866179:0:8704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 8 pid: 6585 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.866190:0:8704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8704:1869685684504192:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071435.866265:0:8704:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071435.869024:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.869103:0:8704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8704:1869685684504192:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071435.869128:0:8704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.869190:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642496 00000100:00100000:3.0:1783071435.869197:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642496 00010000:00010000:3.0:1783071435.869229:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.869274:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:3.0:1783071435.869283:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665642496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071435.869297:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071435.869317:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.869330:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.869353:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011dc044f/0xd360fc6ce6ec7dd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabbd expref: 9 pid: 6585 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.869369:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071435.869384:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071435.869391:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.869400:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.869440:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071435.869514:0:8704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869522:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869543:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869551:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869559:0:8704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869577:0:8704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071435.869582:0:8704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869590:0:8704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869601:0:8704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.869609:0:8704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c84b4d5c/0xd360fc6ce6ec7de9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.870130:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665642496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 845us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071435.870139:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1783071435.870211:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665642368:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 4156us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.870219:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1783071435.872856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.872952:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642752 00000100:00100000:0.0:1783071435.872962:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642752 00000100:00100000:0.0:1783071435.873059:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 186 00000100:00100000:0.0:1783071435.873070:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+17:11465:x1869685665642752:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783071435.873148:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873165:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873193:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873598:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873621:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 18 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873632:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873670:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 18 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.873738:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 18 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.873753:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7551500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684504320:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071435.873832:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071435.876670:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7551500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684504320:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071435.876740:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.877112:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071435.877311:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665642880 00000100:00100000:3.0:1783071435.877318:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665642880 00010000:00010000:3.0:1783071435.877354:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.877394:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:3.0:1783071435.877404:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:2357:x1869685665642880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071435.877419:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071435.877426:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877451:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877474:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7db8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaba8 expref: 19 pid: 6976 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877491:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:3.0:1783071435.877496:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877505:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877527:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.877559:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071435.877609:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:2357:x1869685665642880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 207us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071435.877616:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00010000:00010000:2.0:1783071435.877981:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.878002:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071435.878183:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1783071435.878350:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1783071435.878397:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1783071435.878568:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1869685684504448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783071435.878616:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071435.878648:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071435.878721:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684504448 00000100:00100000:0.0:1783071435.878727:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684504448 00000100:00100000:0.0:1783071435.878762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783071435.878770:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1869685684504448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783071435.878858:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1869685684504448:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.878865:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783071435.878942:0:5792:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1783071435.878948:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782faa0e680, transno 4294967315 00000100:00100000:3.0:1783071435.878967:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1869685684504448:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783071435.879446:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1783071435.879505:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c85500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1869685684504576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783071435.879536:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071435.879552:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071435.879875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684504576 00000100:00100000:0.0:1783071435.879881:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684504576 00000100:00100000:0.0:1783071435.879904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783071435.879911:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1869685684504576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783071435.880063:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5792:x1869685684504576:12345-0@lo:1000:mdt00_001.0 Request processed in 151us (525us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783071435.880071:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783071435.881266:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c85500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5792:1869685684504576:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783071435.881313:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881324:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881333:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881340:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071435.881345:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881371:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881402:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fab800) 00010000:00010000:3.0:1783071435.881405:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071435.881410:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881417:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8800/0xd360fc6ce6ec7df7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881461:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881467:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881474:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881479:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071435.881482:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881487:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881495:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:3.0:1783071435.881497:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071435.881500:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881517:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7d33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881541:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881556:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881564:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881598:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071435.881626:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 21 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.881641:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684504704:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071435.881742:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783071435.884835:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684504704:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071435.884874:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071435.888540:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071435.888652:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665643008 00000100:00100000:0.0:1783071435.888663:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665643008 00010000:00010000:0.0:1783071435.888750:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 22 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071435.888790:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:0.0:1783071435.888799:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:2357:x1869685665643008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071435.888815:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071435.888821:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 22 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888835:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 22 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888856:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcab93 expref: 22 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888893:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:0.0:1783071435.888899:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888907:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888916:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071435.888948:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071435.889004:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:2357:x1869685665643008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 205us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071435.889012:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00010000:00010000:2.0:1783071435.889186:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889195:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889207:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889213:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889220:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889225:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.889229:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889236:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889267:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071435.889269:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071435.889273:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889279:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7dfe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889290:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889295:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889301:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889305:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071435.889308:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889314:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889321:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071435.889323:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071435.889325:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.889331:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec7df0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071435.889552:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11465:x1869685665642752:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 16483us (16703us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1783071435.889561:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 186 00000020:00080000:2.0:1783071435.889564:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783071435.890256:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071435.890262:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071435.890817:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783071435.890828:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071435.903848:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071435.903972:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665643264 00000100:00100000:1.0:1783071435.903982:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665643264 00000100:00100000:1.0:1783071435.904041:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1783071435.904052:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11465:x1869685665643264:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783071435.904964:0:5795:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783071435.905078:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1783071435.905129:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905146:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905158:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905180:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905187:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905194:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071435.905211:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071435.905327:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11465:x1869685665643264:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1275us (1488us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1783071435.905337:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000020:00080000:1.0:1783071435.905341:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071435.905461:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071435.905468:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.905475:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071435.905479:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.905487:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.905501:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9782c4fabb00) 00010000:00010000:2.0:1783071435.905505:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783071435.905510:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.905516:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071435.905532:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071435.905534:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071435.905536:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071435.937513:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783071436.317125:0:12366:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071436.317135:0:12366:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071436.317179:0:12366:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1783071436.317189:0:12366:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783071436.402755:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.402828:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665643520 00000100:00100000:3.0:1783071436.402847:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665643520 00000100:00100000:3.0:1783071436.403049:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:3.0:1783071436.403062:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:11487:x1869685665643520:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071436.403088:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071436.403112:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7e0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabc4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.403371:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7e13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.403386:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7e13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.403397:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7e13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071436.403408:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783071436.405032:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7e0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabc4 expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.405058:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7e13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabc4 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.405069:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071436.405072:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071436.405075:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1e00, rc 0) 00000100:00100000:3.0:1783071436.405150:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11487:x1869685665643520:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2090us (2403us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783071436.405159:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 187 00000100:00100000:3.0:1783071436.412094:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.412148:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665643648 00000100:00100000:1.0:1783071436.412170:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665643648 00000100:00100000:1.0:1783071436.412227:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:1.0:1783071436.412247:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11487:x1869685665643648:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:1.0:1783071436.412326:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412346:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412372:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412391:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412400:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412407:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412759:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412768:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.412776:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071436.413392:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413406:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413411:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413416:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413428:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.413432:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413437:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413446:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071436.413448:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.413451:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413455:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413463:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413467:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413471:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413474:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.413475:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413479:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413490:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.413491:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.413493:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413496:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413507:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413510:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413513:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413516:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.413518:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413522:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413525:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab900) 00010000:00010000:1.0:1783071436.413526:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.413528:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.413531:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.413649:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11487:x1869685665643648:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 1412us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071436.413656:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 188 00000100:00100000:3.0:1783071436.466604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.471825:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665643904 00000100:00100000:1.0:1783071436.471840:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665643904 00000100:00100000:1.0:1783071436.471915:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:1.0:1783071436.471925:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+24:11490:x1869685665643904:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071436.471944:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071436.471963:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabcb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472027:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472041:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472052:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472065:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472072:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472079:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472938:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472950:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.472957:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071436.472968:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783071436.473064:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473072:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473078:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473085:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.473089:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473097:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473109:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071436.473112:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.473117:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473133:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473146:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473153:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473159:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473165:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.473168:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473175:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473183:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab900) 00010000:00010000:1.0:1783071436.473186:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.473188:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473194:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec7e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473252:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473377:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.473391:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.473393:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071436.473396:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3200, rc 0) 00000100:00100000:1.0:1783071436.473508:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11490:x1869685665643904:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1583us (6911us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783071436.473516:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 189 00000100:00100000:2.0:1783071436.482293:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.486959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665644032 00000100:00100000:0.0:1783071436.486974:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665644032 00000100:00100000:0.0:1783071436.487308:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:0.0:1783071436.487319:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11490:x1869685665644032:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1783071436.487397:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487417:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487428:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487465:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487473:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487480:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487486:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.487491:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487498:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487510:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:0.0:1783071436.487514:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071436.487519:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.487525:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7e59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071436.487601:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11490:x1869685665644032:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 282us (5316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071436.487623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 190 00000100:00100000:3.0:1783071436.490338:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.490367:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665644288 00000100:00100000:3.0:1783071436.490374:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665644288 00000100:00100000:3.0:1783071436.490414:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1783071436.490423:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11490:x1869685665644288:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071436.490825:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:11490:x1869685665644288:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 401us (490us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783071436.490833:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1783071436.555997:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071436.556154:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665644544 00000100:00100000:2.0:1783071436.556165:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665644544 00000100:00100000:3.0:1783071436.556734:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:3.0:1783071436.556748:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:11025:x1869685665644544:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071436.556772:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071436.556791:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7e60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabd2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.556879:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.556893:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.556901:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.556932:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.556962:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 28 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071436.556974:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684504832:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071436.557062:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c1254780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071436.561775:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684504832:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071436.561808:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071436.562324:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.562436:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665644672 00000100:00100000:0.0:1783071436.562445:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665644672 00010000:00010000:0.0:1783071436.562493:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 29 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071436.562765:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:0.0:1783071436.562776:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:2357:x1869685665644672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071436.562793:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071436.562801:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 29 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563015:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 29 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563040:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec7e4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabcb expref: 29 pid: 5791 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563057:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:0.0:1783071436.563062:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563071:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563079:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.563115:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071436.563179:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:2357:x1869685665644672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 404us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071436.563187:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00010000:00010000:3.0:1783071436.563263:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.563272:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071436.563289:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783071436.563446:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7e60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.563462:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.563469:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:3.0:1783071436.563472:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071436.563475:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071436.563501:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:11025:x1869685665644544:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6757us (7515us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783071436.563519:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 191 00000100:00100000:2.0:1783071436.569393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.572762:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665644928 00000100:00100000:0.0:1783071436.572779:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665644928 00000100:00100000:2.0:1783071436.573255:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 192 00000100:00100000:2.0:1783071436.573268:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:11025:x1869685665644928:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:2.0:1783071436.573581:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.573601:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.573613:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071436.573961:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1783071436.573992:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e694d094 reply state 000000006a3a721c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071436.574003:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783071436.574057:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1783071436.574262:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11025:x1869685665644928:12345-192.168.202.16@tcp:36:bash.0 Request processed in 995us (4878us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783071436.574271:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 192 00000020:00080000:2.0:1783071436.574276:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783071436.578096:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1783071436.578208:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578222:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578230:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578249:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.578254:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578263:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578281:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:0.0:1783071436.578284:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.578289:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.578295:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7e75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.578632:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645056 00000100:00100000:1.0:1783071436.578643:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645056 00000100:00100000:1.0:1783071436.578737:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:1.0:1783071436.578748:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:11025:x1869685665645056:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071436.578771:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071436.578789:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabd9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.578857:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd9 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.578872:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd9 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.578891:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.578895:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071436.578898:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2000, rc 0) 00000100:00100000:1.0:1783071436.578959:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11025:x1869685665645056:12345-192.168.202.16@tcp:101:bash.0 Request processed in 213us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071436.578985:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 193 00000100:00100000:3.0:1783071436.581360:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.591565:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645184 00000100:00100000:0.0:1783071436.591581:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645184 00000100:00100000:0.0:1783071436.591661:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1783071436.591692:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:11025:x1869685665645184:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1783071436.591711:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071436.591731:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabe0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071436.591772:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4782cb, atime: 0x6a4782ca, ctime: 0x6a4782cb, blocks: 0xb 00010000:00010000:0.0:1783071436.591795:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1783071436.591799:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071436.591809:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.591837:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.591848:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8800, rc 0) 00000100:00100000:0.0:1783071436.591921:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:11025:x1869685665645184:12345-192.168.202.16@tcp:101:bash.0 Request processed in 251us (10570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071436.591928:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1783071436.601189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.603299:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645312 00000100:00100000:0.0:1783071436.603313:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645312 00002000:00010000:2.0:1783071436.603457:0:6591:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783071436.603463:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faf2f480 with x1869685665645312 ext(0->18446744073709551615) 00002000:00010000:2.0:1783071436.603474:0:6591:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782faf2f480. 00000100:00100000:2.0:1783071436.603556:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1783071436.603566:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665645312:12345-192.168.202.16@tcp:10:bash.0 00002000:00010000:2.0:1783071436.603906:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783071436.603911:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783071435 -> 1783071437 00002000:00010000:2.0:1783071436.603914:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783071434 -> 1783071434 00002000:00010000:2.0:1783071436.603916:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783071435 -> 1783071437 00002000:00010000:2.0:1783071436.603919:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783071436.603991:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665645312:12345-192.168.202.16@tcp:10:bash.0 Request processed in 426us (2811us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1783071436.604000:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00002000:00010000:2.0:1783071436.604003:0:6591:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783071436.604006:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9782faf2f480 with x1869685665645312 ext(0->18446744073709551615) 00002000:00010000:2.0:1783071436.604011:0:6591:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9782faf2f480. 00000100:00100000:2.0:1783071436.674532:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.674637:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645440 00000100:00100000:0.0:1783071436.674646:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645440 00000100:00100000:0.0:1783071436.674749:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:0.0:1783071436.674759:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11504:x1869685665645440:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1783071436.674843:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.674860:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.674872:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.674904:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.674913:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.674920:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675224:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675245:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675253:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071436.675293:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675305:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675311:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675317:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675322:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.675326:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675341:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675353:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071436.675355:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.675361:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675367:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675381:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675387:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675392:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675397:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.675400:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675405:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675412:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782cc2b6700) 00010000:00010000:0.0:1783071436.675415:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.675417:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675432:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675448:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675453:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675459:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675463:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.675466:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675472:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675480:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:0.0:1783071436.675482:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.675485:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.675491:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071436.675564:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11504:x1869685665645440:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 805us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071436.675572:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 194 00000100:00100000:0.0:1783071436.702250:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.702372:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645696 00000100:00100000:1.0:1783071436.702398:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645696 00000100:00100000:1.0:1783071436.702467:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:1.0:1783071436.702478:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+32:11507:x1869685665645696:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071436.702500:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071436.702525:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabe7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702626:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702641:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702651:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702665:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702717:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.702726:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703049:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7eb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703068:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703076:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071436.703087:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783071436.703175:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703182:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703189:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703195:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.703200:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703207:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703219:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071436.703222:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.703227:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703246:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ea6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703258:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703271:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703277:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703281:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.703284:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703290:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703298:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab900) 00010000:00010000:1.0:1783071436.703300:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.703303:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703308:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703354:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7e9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe7 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703368:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe7 expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.703375:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.703378:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783071436.703386:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2600, rc 0) 00000100:00100000:1.0:1783071436.703448:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11507:x1869685665645696:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 972us (1220us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1783071436.703455:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 195 00000100:00100000:1.0:1783071436.706777:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.706869:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665645824 00000100:00100000:0.0:1783071436.706879:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665645824 00000100:00100000:0.0:1783071436.706945:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:0.0:1783071436.706955:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11507:x1869685665645824:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1783071436.707029:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.707046:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.707056:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.707092:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.707108:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 34 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071436.707123:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7552680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684504960:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071436.707228:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287600 going to sleep for 11 seconds 00000100:00100000:2.0:1783071436.714443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.714578:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665646080 00000100:00100000:1.0:1783071436.714587:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665646080 00000100:00100000:1.0:1783071436.714653:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1783071436.714663:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:6028:x1869685665646080:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783071436.714990:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:6028:x1869685665646080:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 328us (558us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783071436.714998:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1783071436.717148:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7552680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684504960:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071436.717180:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071436.718729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.718799:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665646208 00000100:00100000:1.0:1783071436.718809:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665646208 00010000:00010000:1.0:1783071436.718851:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 36 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.718935:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:1.0:1783071436.718946:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:2358:x1869685665646208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071436.718963:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071436.718970:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 36 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.718983:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 36 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.719004:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7e67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd2 expref: 36 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.719036:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.719041:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.719049:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.719056:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.719091:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071436.719152:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:2358:x1869685665646208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 208us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071436.719160:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00010000:00010000:2.0:1783071436.719260:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719269:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719310:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719318:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719324:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719329:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071436.719339:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719346:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719355:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:2.0:1783071436.719358:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071436.719361:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.719367:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071436.719412:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11507:x1869685665645824:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 12459us (12647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071436.719421:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 196 00000100:00100000:2.0:1783071436.722182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.722273:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665646464 00000100:00100000:3.0:1783071436.722283:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665646464 00000100:00100000:3.0:1783071436.722349:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1783071436.722359:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+34:11507:x1869685665646464:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071436.722639:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11507:x1869685665646464:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 280us (465us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1783071436.722647:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1783071436.820404:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.820530:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665646720 00000100:00100000:1.0:1783071436.820540:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665646720 00000100:00100000:1.0:1783071436.820615:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:1.0:1783071436.820626:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+35:11518:x1869685665646720:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1783071436.820653:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071436.820698:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabee expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820772:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820787:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820799:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820826:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820833:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.820840:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821139:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7ede lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821148:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821156:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071436.821166:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1783071436.821276:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821283:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821289:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821295:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.821299:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821317:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821330:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071436.821333:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.821338:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821343:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7ed0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821355:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821361:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821366:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821371:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.821374:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821380:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821386:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab900) 00010000:00010000:1.0:1783071436.821389:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.821391:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821406:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7ed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821447:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabee expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821463:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabee expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.821472:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:1.0:1783071436.821474:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071436.821476:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3400, rc 0) 00000100:00100000:1.0:1783071436.821544:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:11518:x1869685665646720:12345-192.168.202.16@tcp:101:cat.0 Request processed in 919us (1149us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783071436.821551:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 197 00000100:00100000:2.0:1783071436.835209:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.835405:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665646976 00000100:00100000:3.0:1783071436.835417:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665646976 00000100:00100000:3.0:1783071436.835489:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1783071436.835500:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:11518:x1869685665646976:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:3.0:1783071436.835778:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11518:x1869685665646976:12345-192.168.202.16@tcp:35:cat.0 Request processed in 279us (578us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783071436.835786:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1783071436.863798:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.863904:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665647232 00000100:00100000:0.0:1783071436.863914:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665647232 00000100:00100000:0.0:1783071436.863983:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 198 00000100:00100000:0.0:1783071436.863993:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11519:x1869685665647232:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:0.0:1783071436.864052:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783071436.864080:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec7ede lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabee expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864102:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2600/0xd360fc6ce6ec7eb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe7 expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864115:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2000/0xd360fc6ce6ec7e7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabd9 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864124:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782c4fab100) 00010000:00010000:0.0:1783071436.864134:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071436.864155:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864168:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864177:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864193:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864200:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864207:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864760:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864770:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.864777:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071436.865354:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1783071436.865365:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338239690877ns, next at 339239688520ns, rc = 0 00010000:00010000:0.0:1783071436.865945:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.865958:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.865967:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.865975:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.865982:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.865988:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866056:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071436.866076:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866091:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866097:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866103:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.866107:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866115:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866127:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6600) 00010000:00010000:0.0:1783071436.866130:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783071436.866134:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866140:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7efa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866158:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866164:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866169:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866174:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.866181:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866187:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866194:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071436.866197:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.866199:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.866204:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7eec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071436.866213:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b65cd2a1 reply state 00000000b67943d0 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071436.866222:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071436.866385:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+37:11519:x1869685665647232:12345-192.168.202.16@tcp:36:rm.0 Request processed in 2379us (2582us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783071436.866395:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 198 00010000:00010000:2.0:1783071436.867019:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071436.867028:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.867035:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071436.867038:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.867046:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.867057:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9782cc2b6600) 00010000:00010000:2.0:1783071436.867068:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783071436.867072:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.867078:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.867094:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071436.867096:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071436.867098:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071436.889284:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889303:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889312:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889319:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071436.889324:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889333:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889351:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782cc2b6700) 00010000:00010000:2.0:1783071436.889354:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071436.889359:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071436.889365:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7ef3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071436.913728:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071436.914119:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665647488 00000100:00100000:1.0:1783071436.914129:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665647488 00000100:00100000:1.0:1783071436.914180:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 199 00000100:00100000:1.0:1783071436.914189:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+36:11525:x1869685665647488:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071436.914213:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071436.914244:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7f08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabf5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914592:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914619:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914643:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914659:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914666:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.914701:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783071436.915239:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1783071436.915407:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915417:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915433:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915466:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915473:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915480:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915487:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071436.915498:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915505:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915517:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:1.0:1783071436.915520:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071436.915525:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915532:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec7f0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071436.915544:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000840f1c0e reply state 000000004da56703 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.915553:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783071436.915583:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec7f08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915596:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.915603:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:1.0:1783071436.915605:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071436.915607:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2e00, rc 0) 00000100:00100000:1.0:1783071436.915723:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:11525:x1869685665647488:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1534us (2004us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1783071436.915730:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 199 00010000:00010000:0.0:1783071436.918901:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.918918:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.918926:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.918932:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071436.918936:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.918958:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.918988:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782c4fab900) 00010000:00010000:0.0:1783071436.918991:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071436.918996:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071436.919001:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec7f16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071436.922368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.922785:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665647616 00000100:00100000:3.0:1783071436.922796:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665647616 00000100:00100000:3.0:1783071436.924500:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:3.0:1783071436.924520:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665647616:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071436.924539:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071436.924559:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcabfc expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071436.924615:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071436.924637:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1783071436.924642:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071436.924652:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.924689:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.924703:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef1a00, rc 0) 00000100:00100000:3.0:1783071436.924782:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2357:x1869685665647616:12345-192.168.202.16@tcp:101:bash.0 Request processed in 270us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071436.924789:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1783071436.931248:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071436.932334:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665647744 00000100:00100000:3.0:1783071436.932345:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665647744 00000100:00100000:3.0:1783071436.932411:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:3.0:1783071436.932600:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:11525:x1869685665647744:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1783071436.932622:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071436.932641:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac03 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.932705:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.932715:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071436.932733:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071436.932739:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.932773:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.932786:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071436.932799:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684505088:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071436.932903:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782e285ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071436.935167:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6585:1869685684505088:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071436.935207:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071436.935227:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0e00, rc 0) 00000100:00100000:3.0:1783071436.936340:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:11525:x1869685665647744:12345-192.168.202.16@tcp:101:bash.0 Request processed in 3911us (5104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071436.936351:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1783071436.936664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.936997:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665647872 00000100:00100000:0.0:1783071436.937005:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665647872 00010000:00010000:0.0:1783071436.937260:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.937385:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:1.0:1783071436.937397:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665647872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071436.937412:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071436.937436:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.937449:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.937472:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c5a658/0xd360fc6ce6ec7f2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabfc expref: 7 pid: 6587 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.937488:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071436.937492:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071436.937500:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.937510:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071436.937555:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071436.937569:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1869685684505216:192.168.202.16@tcp:105: 00000100:00100000:1.0:1783071436.937651:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c307fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071436.939415:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1869685684505216:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071436.939439:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071436.939536:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665647872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2141us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071436.939546:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:2.0:1783071436.940531:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071436.940847:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665648128 00000100:00100000:0.0:1783071436.940856:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665648128 00000100:00100000:0.0:1783071436.940905:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1783071436.940914:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+38:11525:x1869685665648128:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1783071436.941456:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:11525:x1869685665648128:12345-192.168.202.16@tcp:35:bash.0 Request processed in 540us (939us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783071436.941481:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00010000:00010000:1.0:1783071436.967412:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071437.069108:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.069257:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665648256 00000100:00100000:0.0:1783071437.069267:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665648256 00000100:00080000:2.0:1783071437.069521:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071437.069582:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:0.0:1783071437.069595:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+39:11541:x1869685665648256:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071437.069620:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071437.069639:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac0a expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069731:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069745:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069755:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071437.069814:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783071437.069817:0:6976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071437.069841:0:6976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069866:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec7f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac0a expref: 41 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069885:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac0a expref: 40 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.069914:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071437.069917:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071437.069921:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071437.070079:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:11541:x1869685665648256:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 487us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071437.070086:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 200 00000100:00100000:1.0:1783071437.078599:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.078649:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665648512 00000100:00100000:3.0:1783071437.078659:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665648512 00000100:00100000:3.0:1783071437.078747:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:3.0:1783071437.078757:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+40:11541:x1869685665648512:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071437.078778:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071437.078798:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7f47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac11 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.078909:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.078923:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.078934:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071437.078946:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783071437.079089:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac11 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.079117:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac11 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.079126:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:3.0:1783071437.079128:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071437.079132:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c4ef0200, rc 0) 00000100:00100000:3.0:1783071437.079595:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+42:11541:x1869685665648512:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 839us (1005us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783071437.079603:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 201 00000100:00100000:1.0:1783071437.086068:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071437.086112:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.086185:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665648896 00000100:00100000:2.0:1783071437.086185:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665648768 00000100:00100000:3.0:1783071437.086194:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665648896 00000100:00100000:2.0:1783071437.086194:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665648768 00000100:00100000:3.0:1783071437.086266:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1783071437.086266:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:3.0:1783071437.086276:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:2357:x1869685665648896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783071437.086276:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:11541:x1869685665648768:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071437.086295:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071437.086297:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.086315:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7f5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac18 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.086326:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac11 expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.086339:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:3.0:1783071437.086344:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071437.086394:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:2357:x1869685665648896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071437.086402:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:2.0:1783071437.086409:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.086423:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.086433:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.086446:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783071437.086562:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec7f5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac18 expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.086588:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac18 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.086595:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:2.0:1783071437.086598:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783071437.086601:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:2.0:1783071437.086728:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:11541:x1869685665648768:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 453us (669us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1783071437.086735:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 202 00000100:00100000:1.0:1783071437.092886:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.092995:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649024 00000100:00100000:0.0:1783071437.093004:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649024 00000100:00100000:0.0:1783071437.093120:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1783071437.093130:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+6:2358:x1869685665649024:12345-192.168.202.16@tcp:1:lfs.0 00010000:00010000:0.0:1783071437.093171:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.093191:0:8704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.093200:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071437.093204:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071437.093208:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.093256:0:8704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.093269:0:8704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 6 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.093296:0:8704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8704:1869685684505344:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071437.093387:0:8704:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb2870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071437.096191:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.096223:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649152 00000100:00100000:0.0:1783071437.096241:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649152 00000100:00100000:1.0:1783071437.096274:0:8704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8704:1869685684505344:192.168.202.16@tcp:104: 00002000:00100000:0.0:1783071437.096285:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9781c7550700 x1869685665649152/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:28/0 lens 504/0 e 0 to 0 dl 1783071448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783071437.096298:0:8704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1783071437.096305:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c7550700 with x1869685665649152 ext(0->8) 00010000:00010000:0.0:1783071437.096312:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 7 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.096324:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 7 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071437.096332:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9781c7550700 00000100:00100000:0.0:1783071437.096365:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1783071437.096374:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665649152:12345-192.168.202.16@tcp:4:lfs.0 00000100:00080000:2.0:1783071437.096514:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071437.096841:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665649152:12345-192.168.202.16@tcp:4:lfs.0 Request processed in 466us (657us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783071437.096849:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00002000:00100000:0.0:1783071437.096856:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9781c7550700 x1869685665649152/t4294967308(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:28/0 lens 504/448 e 0 to 0 dl 1783071448 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071437.096864:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c7550700 with x1869685665649152 ext(0->8) 00010000:00010000:0.0:1783071437.096875:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.096886:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071437.096893:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9781c7550700 00000100:00100000:1.0:1783071437.099302:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.099340:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649280 00000100:00100000:0.0:1783071437.099349:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649280 00010000:00010000:0.0:1783071437.099384:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.099583:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1783071437.099591:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665649280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071437.099606:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783071437.099624:0:5777:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783071437.099627:0:5777:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783071437 00002000:00010000:0.0:1783071437.099630:0:5777:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783071437 00002000:00010000:0.0:1783071437.099642:0:5777:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783071437 00010000:00010000:0.0:1783071437.099648:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.099662:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.099698:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff943d0/0xd360fc6ce6ec7f32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac03 expref: 9 pid: 6585 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.099728:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071437.099731:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071437.099735:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.099742:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.099767:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071437.099798:0:8704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.099808:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.099832:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.099836:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2357:x1869685665649280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 245us (543us total) trans 0 rc 0/0 00010000:00010000:1.0:1783071437.099841:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.099843:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00010000:00010000:1.0:1783071437.099848:0:8704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.099855:0:8704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071437.099859:0:8704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.100272:0:8704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.100284:0:8704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.100292:0:8704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d4f636c/0xd360fc6ce6ec7f71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.100404:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665649024:12345-192.168.202.16@tcp:1:lfs.0 Request processed in 7274us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.100413:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:1.0:1783071437.103042:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.103101:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649536 00000100:00100000:2.0:1783071437.103109:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649536 00000100:00100000:2.0:1783071437.103154:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1783071437.103165:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+43:11541:x1869685665649536:12345-192.168.202.16@tcp:35:lfs.0 00000004:00010000:2.0:1783071437.103223:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac18 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071437.103748:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1783071437.103785:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1783071437.104091:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1783071437.104143:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.104158:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.104167:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.104217:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.104240:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 47 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071437.104255:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684505472:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071437.104347:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071437.108758:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.108879:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5794:1869685684505472:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071437.108978:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.109403:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649664 00000100:00100000:1.0:1783071437.109412:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649664 00010000:00010000:1.0:1783071437.109500:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 48 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.109540:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:1.0:1783071437.109549:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+48:2357:x1869685665649664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071437.109562:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071437.109568:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 48 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109576:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 48 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109607:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2e00/0xd360fc6ce6ec7f1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabf5 expref: 48 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109623:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:1.0:1783071437.109627:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109637:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109645:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.109688:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071437.109708:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.109715:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.109742:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+47:2357:x1869685665649664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 193us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.109749:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000001:00080000:0.0:1783071437.109841:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783071437.110211:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1783071437.110329:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7551180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684505600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071437.110388:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071437.110520:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684505600 00000100:00100000:2.0:1783071437.110525:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684505600 00000100:00100000:0.0:1783071437.110534:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071437.110581:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783071437.110589:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869685684505600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783071437.110666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869685684505600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.110703:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783071437.110776:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071437.110859:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7551180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684505600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071437.112541:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1783071437.112635:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7551180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684505728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783071437.113033:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071437.113057:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fb287e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071437.113350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684505728 00000100:00100000:2.0:1783071437.113359:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684505728 00000100:00100000:1.0:1783071437.113516:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071437.113529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1869685684505728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783071437.113734:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1869685684505728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 208us (701us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783071437.113739:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783071437.113819:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7551180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5794:1869685684505728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783071437.113870:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1783071437.113906:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114502:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114513:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114520:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.114524:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114530:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114543:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:0.0:1783071437.114546:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783071437.114548:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.114553:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec7f78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071437.114759:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783071437.114829:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1783071437.114837:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338489162571ns, next at 339489161093ns, rc = 0 00000001:00080000:0.0:1783071437.114861:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1783071437.114893:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab400) 00010000:00010000:0.0:1783071437.114895:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783071437.114901:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec7f63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac18 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.115176:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:11541:x1869685665649536:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 12012us (12140us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1783071437.115185:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000020:00080000:0.0:1783071437.115189:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783071437.117516:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071437.117558:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665649792 00000100:00100000:1.0:1783071437.117567:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665649792 00000100:00100000:1.0:1783071437.117620:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:1.0:1783071437.117630:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+50:11541:x1869685665649792:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071437.117654:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071437.117775:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7f7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.117891:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac1f expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.117903:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac1f expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.117980:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:1.0:1783071437.117983:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071437.117986:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2200, rc 0) 00000100:00100000:1.0:1783071437.118032:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:11541:x1869685665649792:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 404us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.118040:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 203 00000100:00100000:2.0:1783071437.120659:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.120847:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665650048 00000100:00100000:3.0:1783071437.120856:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665650048 00000100:00100000:3.0:1783071437.120908:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:3.0:1783071437.120927:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+51:11541:x1869685665650048:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1783071437.121292:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11541:x1869685665650048:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 374us (643us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1783071437.121310:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1783071437.187760:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.187874:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665650176 00000100:00100000:0.0:1783071437.187883:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665650176 00000100:00100000:0.0:1783071437.187937:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:0.0:1783071437.187948:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11551:x1869685665650176:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:0.0:1783071437.188022:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188035:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188043:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188052:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188056:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188060:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188165:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188173:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188179:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071437.188219:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188239:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188247:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188253:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188260:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.188264:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188272:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188283:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:0.0:1783071437.188286:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071437.188290:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188302:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec7f86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188317:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188323:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188329:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188334:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.188337:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188343:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188352:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782cc2b6e00) 00010000:00010000:0.0:1783071437.188354:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071437.188356:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188361:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec7f8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188387:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188393:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188404:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188408:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.188411:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188416:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188432:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071437.188435:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071437.188437:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.188442:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7f94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.188522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11551:x1869685665650176:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 574us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071437.188530:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 204 00000100:00100000:2.0:1783071437.223943:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.224036:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665650432 00000100:00100000:3.0:1783071437.224047:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665650432 00000100:00100000:3.0:1783071437.224112:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:3.0:1783071437.224122:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+52:11554:x1869685665650432:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071437.224146:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071437.224169:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac26 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224269:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224283:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224294:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224309:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224317:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224322:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224461:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224469:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224477:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071437.224485:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783071437.224575:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224582:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224594:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224600:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071437.224604:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224611:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224622:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071437.224625:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071437.224629:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224635:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1a00/0xd360fc6ce6ec7fa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224647:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224652:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224658:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224663:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071437.224666:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224929:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224938:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9936d00) 00010000:00010000:3.0:1783071437.224940:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071437.224943:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.224949:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0e00/0xd360fc6ce6ec7fa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.225208:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0200/0xd360fc6ce6ec7f9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.225224:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.225247:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.225249:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071437.225252:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217d000, rc 0) 00000100:00100000:2.0:1783071437.225321:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11554:x1869685665650432:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1200us (1388us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783071437.225329:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 205 00000100:00100000:1.0:1783071437.231610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.231988:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665650560 00000100:00100000:0.0:1783071437.231999:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665650560 00000100:00100000:0.0:1783071437.232050:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:0.0:1783071437.232060:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11554:x1869685665650560:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1783071437.232129:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232147:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232174:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232203:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232209:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232217:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232222:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.232226:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232243:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232256:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071437.232259:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783071437.232263:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.232269:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.232348:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11554:x1869685665650560:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 288us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071437.232356:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 206 00000100:00100000:3.0:1783071437.234788:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.234895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665650816 00000100:00100000:0.0:1783071437.234916:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665650816 00000100:00100000:0.0:1783071437.234971:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1783071437.234981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+54:11554:x1869685665650816:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071437.235191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:11554:x1869685665650816:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 211us (411us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783071437.235199:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1783071437.298261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.298367:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651072 00000100:00100000:2.0:1783071437.298387:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651072 00000100:00100000:2.0:1783071437.298455:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:2.0:1783071437.298466:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:11564:x1869685665651072:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071437.298492:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.298495:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783071437.298523:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9200/0xd360fc6ce6ec7f40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac0a expref: 55 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298542:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071437.298547:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071437.298560:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7fc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac2d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298720:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298735:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298764:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298802:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.298815:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 55 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071437.298828:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684505856:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071437.298929:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071437.303911:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.304008:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684505856:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071437.304039:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.304116:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651200 00000100:00100000:0.0:1783071437.304124:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651200 00010000:00010000:0.0:1783071437.304163:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 56 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.304205:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:0.0:1783071437.304214:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+56:2357:x1869685665651200:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071437.304243:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071437.304250:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 56 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304264:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 56 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304294:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec7fb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac26 expref: 56 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304313:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071437.304318:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304328:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304352:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.304382:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071437.304451:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:2357:x1869685665651200:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 236us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071437.304459:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00010000:00010000:2.0:1783071437.304642:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.304648:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.304663:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783071437.304842:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec7fc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.304853:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.304866:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.304868:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071437.304870:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:2.0:1783071437.304902:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:11564:x1869685665651072:12345-192.168.202.16@tcp:101:bash.0 Request processed in 6439us (6681us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783071437.304907:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 207 00000100:00100000:1.0:1783071437.307828:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.307938:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651456 00000100:00100000:0.0:1783071437.307948:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651456 00000100:00100000:0.0:1783071437.307997:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 208 00000100:00100000:0.0:1783071437.308007:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+55:11564:x1869685665651456:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:0.0:1783071437.308287:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.308304:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.308315:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071437.308369:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1783071437.308407:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3d5eaf5 reply state 000000006921a53b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071437.308416:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783071437.308519:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11564:x1869685665651456:12345-192.168.202.16@tcp:36:bash.0 Request processed in 513us (701us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783071437.308527:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 208 00000020:00080000:0.0:1783071437.308531:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071437.310509:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310525:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310532:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310539:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.310544:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310551:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310567:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.310570:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.310574:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.310580:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec7fda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.312482:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.312627:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651584 00000100:00100000:2.0:1783071437.312637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651584 00000100:00100000:2.0:1783071437.312738:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:2.0:1783071437.312750:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:11564:x1869685665651584:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1783071437.312775:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.312795:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7fe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac34 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.312873:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.312890:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.312897:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.312930:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.312943:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 58 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071437.312957:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684505984:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071437.313036:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071437.315655:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5791:1869685684505984:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071437.315710:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.319725:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.320378:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651712 00000100:00100000:3.0:1783071437.320390:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651712 00010000:00010000:3.0:1783071437.320598:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 59 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071437.320649:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1783071437.320659:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:2357:x1869685665651712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071437.320771:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071437.320780:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 59 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.320794:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 59 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.320819:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec7fcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac2d expref: 59 pid: 5793 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.320851:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071437.320855:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.320862:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.320867:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.321351:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071437.321352:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.321360:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.321549:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783071437.321554:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071437.321575:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.321621:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7fe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.321638:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.321647:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.321649:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071437.321652:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938c00, rc 0) 00000100:00100000:3.0:1783071437.321931:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:2357:x1869685665651712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1271us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.321959:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11564:x1869685665651584:12345-192.168.202.16@tcp:101:bash.0 Request processed in 9211us (9486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.321966:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 209 00000100:00100000:3.0:1783071437.322255:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:3.0:1783071437.325544:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.325639:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665651968 00000100:00100000:0.0:1783071437.325648:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665651968 00000100:00100000:0.0:1783071437.325924:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1783071437.325936:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+57:11564:x1869685665651968:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1783071437.326158:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11564:x1869685665651968:12345-192.168.202.16@tcp:35:bash.0 Request processed in 222us (622us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783071437.326164:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1783071437.379747:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.379827:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652096 00000100:00100000:2.0:1783071437.379835:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652096 00000100:00100000:2.0:1783071437.379885:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:2.0:1783071437.379895:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+58:11570:x1869685665652096:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071437.379919:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.379956:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac3b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380022:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380034:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380042:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.380094:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783071437.380097:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071437.380113:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380131:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec7fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac3b expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380147:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac3b expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.380157:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071437.380160:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071437.380163:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939000, rc 0) 00000100:00100000:2.0:1783071437.380220:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665652096:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 326us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.380225:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 210 00000100:00100000:2.0:1783071437.382957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.383070:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652224 00000100:00100000:3.0:1783071437.383080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652224 00000100:00100000:3.0:1783071437.383159:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:3.0:1783071437.383169:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665652224:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071437.383190:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071437.383210:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec7ffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac42 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383286:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383301:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383325:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383340:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383347:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383354:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383472:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383480:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383486:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071437.383526:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783071437.383531:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071437.383548:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383559:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383568:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383582:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383587:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383592:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071437.383801:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383811:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383824:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071437.383827:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071437.383832:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383838:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383852:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383858:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383864:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383869:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071437.383877:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383884:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383892:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9936d00) 00010000:00010000:3.0:1783071437.383895:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071437.383897:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383903:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec800b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383934:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec7ffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac42 expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383947:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac42 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.383953:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071437.383955:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071437.383957:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c000, rc 0) 00000100:00100000:3.0:1783071437.384243:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11570:x1869685665652224:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1074us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071437.384251:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 211 00000100:00100000:3.0:1783071437.394435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071437.394486:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071437.394570:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652608 00000100:00100000:0.0:1783071437.394582:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652608 00000100:00100000:0.0:1783071437.394654:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071437.394665:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:2357:x1869685665652608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071437.394714:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071437.394741:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac42 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.394763:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071437.394768:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071437.394826:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:2357:x1869685665652608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 163us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071437.394834:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1783071437.396451:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652480 00000100:00100000:1.0:1783071437.396463:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652480 00000100:00100000:1.0:1783071437.396525:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:1.0:1783071437.396534:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665652480:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071437.396554:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071437.396572:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec8019 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac49 expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.396722:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.396736:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.396745:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.396780:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.396792:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 60 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.396804:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684506112:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071437.396891:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c307f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071437.400816:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684506112:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071437.400845:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071437.402045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071437.402120:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652736 00000100:00100000:1.0:1783071437.402127:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652736 00010000:00010000:1.0:1783071437.402165:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 61 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.402203:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:1.0:1783071437.402256:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:2357:x1869685665652736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071437.402276:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071437.402284:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 61 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402296:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 61 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402320:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec7fe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac34 expref: 61 pid: 5791 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402335:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:1.0:1783071437.402341:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402350:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402358:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071437.402387:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071437.402451:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:2357:x1869685665652736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 227us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071437.402460:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00010000:00010000:2.0:1783071437.402542:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.402550:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.402569:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783071437.402750:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2400/0xd360fc6ce6ec8019 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 61 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.402766:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 60 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.402773:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.402775:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783071437.402778:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2800, rc 0) 00000100:00100000:2.0:1783071437.402803:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11570:x1869685665652480:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 6271us (8385us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783071437.402810:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 212 00000100:00100000:3.0:1783071437.406487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.406592:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665652992 00000100:00100000:2.0:1783071437.406612:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665652992 00000100:00100000:2.0:1783071437.406715:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1783071437.406725:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11570:x1869685665652992:12345-192.168.202.16@tcp:103:lfs.0 00010000:00010000:2.0:1783071437.406743:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071437.406768:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2200/0xd360fc6ce6ec7f7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac1f expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.406788:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.406802:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071437.406859:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665652992:12345-192.168.202.16@tcp:103:lfs.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.406867:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1783071437.408523:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.408610:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653120 00000100:00100000:2.0:1783071437.408618:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653120 00000100:00100000:2.0:1783071437.408705:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:2.0:1783071437.408715:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665653120:12345-192.168.202.16@tcp:58:lfs.0 00010000:00010000:2.0:1783071437.408814:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.408830:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.408840:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071437.409032:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783071437.409116:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665653120:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 402us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.409123:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 213 00000100:00100000:3.0:1783071437.412827:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.412937:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653248 00000100:00100000:2.0:1783071437.412948:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653248 00000100:00100000:2.0:1783071437.413012:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:2.0:1783071437.413022:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+59:11570:x1869685665653248:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1783071437.413045:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.413068:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac50 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413145:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413157:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413175:0:5792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413188:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413201:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.413204:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071437.413208:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.413215:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938c00, rc 0) 00000100:00100000:2.0:1783071437.413291:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11570:x1869685665653248:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 270us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.413300:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 214 00000040:00080000:0.0:1783071437.920928:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071437.920937:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071437.920968:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1783071437.920976:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071437.921100:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7551c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684506240:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071437.921208:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071437.932846:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7551c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684506240:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783071437.939378:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.943879:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653376 00000100:00100000:2.0:1783071437.943895:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653376 00000100:00100000:2.0:1783071437.943974:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:2.0:1783071437.943985:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11571:x1869685665653376:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071437.944028:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071437.944168:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11571:x1869685665653376:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 184us (4800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.944176:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 215 00000100:00100000:3.0:1783071437.949755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.950531:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653504 00000100:00100000:2.0:1783071437.950544:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653504 00000100:00100000:2.0:1783071437.950615:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:2.0:1783071437.950626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11571:x1869685665653504:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.950729:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950747:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950761:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950775:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950782:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950788:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950811:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950820:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950825:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.950878:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783071437.950882:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071437.950894:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950904:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950911:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950918:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950923:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.950928:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950934:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950946:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:2.0:1783071437.950949:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.950953:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950958:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec803c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950970:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950985:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950991:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.950995:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.950998:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951004:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951011:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9782d9b38200) 00010000:00010000:2.0:1783071437.951013:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.951016:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951021:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8043 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951036:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951041:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951046:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951050:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.951061:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951068:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951076:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.951078:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.951081:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.951087:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec804a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071437.951170:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11571:x1869685665653504:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 545us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.951179:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 216 00000100:00100000:1.0:1783071437.953800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.954572:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653760 00000100:00100000:2.0:1783071437.954587:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653760 00000100:00100000:2.0:1783071437.954699:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:2.0:1783071437.954712:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+60:11571:x1869685665653760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.954737:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.954758:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec8051 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac57 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.954867:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.954883:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.954913:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071437.954926:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783071437.955042:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955051:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955058:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955064:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.955069:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955076:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955089:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071437.955092:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071437.955097:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955103:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955152:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec8051 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac57 expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955175:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:2.0:1783071437.955177:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071437.955181:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec8051 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac57 expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.955190:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:2.0:1783071437.955275:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665653760:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 565us (1483us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1783071437.955283:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 217 00000100:00100000:3.0:1783071437.963836:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.963948:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665653888 00000100:00100000:2.0:1783071437.963959:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665653888 00000100:00100000:2.0:1783071437.964021:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:2.0:1783071437.964031:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665653888:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071437.964096:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071437.964235:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665653888:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 193us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.964243:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 218 00000100:00100000:0.0:1783071437.967631:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.968271:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665654144 00000100:00100000:2.0:1783071437.968284:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665654144 00000100:00100000:2.0:1783071437.968361:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:2.0:1783071437.968370:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665654144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.968392:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.968396:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783071437.968433:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939000/0xd360fc6ce6ec7ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac3b expref: 61 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.968470:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071437.968475:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071437.968491:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec8066 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac5e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783071437.969645:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1783071437.969881:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec806d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.969897:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec806d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.969907:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec806d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.969965:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec8066 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac5e expref: 63 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.969983:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec806d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac5e expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.969991:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071437.969994:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783071437.969996:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071437.970069:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+62:11571:x1869685665654144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1700us (2452us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1783071437.970077:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 219 00000100:00100000:3.0:1783071437.975800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.975934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665654400 00000100:00100000:2.0:1783071437.975944:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665654400 00000100:00100000:2.0:1783071437.976004:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:2.0:1783071437.976014:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+62:11571:x1869685665654400:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.976072:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071437.976098:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec806d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac5e expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976118:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38200) 00010000:00010000:2.0:1783071437.976128:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071437.976149:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976161:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976170:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976241:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976249:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976256:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976345:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976386:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976393:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976399:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.976404:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976420:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976430:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:2.0:1783071437.976433:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.976438:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976444:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec807b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976455:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976461:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976466:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976471:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071437.976480:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976486:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976494:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa5e9a1a8 (ffff9782d9b38f00) 00010000:00010000:2.0:1783071437.976497:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071437.976500:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.976505:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec8082 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa5e9a1a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071437.976591:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665654400:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 578us (801us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071437.976598:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:3.0:1783071437.979808:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.979899:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665654528 00000100:00100000:2.0:1783071437.979909:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665654528 00000100:00100000:2.0:1783071437.979964:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:2.0:1783071437.979973:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+61:11571:x1869685665654528:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.979992:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.980014:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8089 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac65 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980049:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980061:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980092:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980186:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8089 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980205:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.980214:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:2.0:1783071437.980216:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071437.980220:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939e00, rc 0) 00000100:00100000:2.0:1783071437.980289:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+62:11571:x1869685665654528:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 316us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.980296:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 221 00000100:00100000:3.0:1783071437.983318:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1783071437.984957:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071437.985086:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665654784 00000100:00100000:2.0:1783071437.985097:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665654784 00000100:00100000:3.0:1783071437.985290:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 222 00000100:00100000:3.0:1783071437.985302:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+62:11571:x1869685665654784:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071437.985399:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.985426:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071437.985438:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783071437.986238:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1783071437.986251:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339360576353ns, next at 340360574355ns, rc = 0 00000004:00010000:3.0:1783071437.986359:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c30c234 reply state 000000004c6966f0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071437.986371:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071437.987134:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+64:11571:x1869685665654784:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1829us (3820us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783071437.987143:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 222 00010000:00010000:0.0:1783071437.990408:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071437.990498:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.990578:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665654912 00000100:00100000:2.0:1783071437.990588:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665654912 00000100:00100000:2.0:1783071437.990658:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:2.0:1783071437.990668:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+64:11571:x1869685665654912:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071437.990716:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071437.990734:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac6c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.990882:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.990888:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.991019:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 65 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.991052:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 65 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071437.991073:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:2.0:1783071437.991076:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783071437.991079:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939c00, rc 0) 00000100:00100000:2.0:1783071437.991134:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+65:11571:x1869685665654912:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 467us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071437.991142:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 223 00000100:00100000:3.0:1783071437.993468:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.993712:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665655040 00000100:00100000:2.0:1783071437.993721:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665655040 00000100:00100000:2.0:1783071437.993797:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1783071437.993807:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2357:x1869685665655040:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783071437.994085:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2357:x1869685665655040:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 279us (625us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783071437.994093:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00010000:00010000:0.0:1783071437.994557:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071437.994565:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.994577:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.994704:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:0.0:1783071437.994708:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783071437.994712:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071437.994719:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783071437.994890:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071437.996894:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071437.997080:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665655296 00000100:00100000:2.0:1783071437.997089:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665655296 00000100:00100000:2.0:1783071437.997149:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1783071437.997159:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+64:11571:x1869685665655296:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783071437.997423:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+65:11571:x1869685665655296:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 256us (529us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783071437.997431:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1783071438.000000:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071438.000182:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665655552 00000100:00100000:2.0:1783071438.000206:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665655552 00000100:00100000:2.0:1783071438.000291:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:2.0:1783071438.000300:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+65:11571:x1869685665655552:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783071438.000563:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+65:11571:x1869685665655552:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 263us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.000571:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 224 00000100:00100000:1.0:1783071438.002810:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071438.003065:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665655680 00000100:00100000:2.0:1783071438.003073:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665655680 00000100:00100000:2.0:1783071438.003126:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:2.0:1783071438.003136:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+65:11571:x1869685665655680:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071438.003157:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071438.003178:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec80a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac73 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003255:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003269:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003279:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071438.003315:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071438.003333:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003362:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec80a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac73 expref: 67 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003405:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac73 expref: 66 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.003422:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:2.0:1783071438.003425:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783071438.003428:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071438.003486:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+66:11571:x1869685665655680:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 351us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.003495:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 225 00000100:00100000:3.0:1783071438.006923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.007028:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665655808 00000100:00100000:0.0:1783071438.007037:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665655808 00000100:00100000:0.0:1783071438.007094:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1783071438.007104:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+10:2358:x1869685665655808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071438.007137:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071438.007159:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac7a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783071438.007184:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4782ce, blocks: 0x1 00010000:00010000:0.0:1783071438.007202:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1783071438.007206:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071438.007215:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.007263:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.007276:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8200, rc 0) 00000100:00100000:0.0:1783071438.007338:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:2358:x1869685665655808:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 236us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.007345:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:1.0:1783071438.013818:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.014036:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656064 00000100:00100000:3.0:1783071438.014045:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656064 00000100:00100000:3.0:1783071438.014101:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:3.0:1783071438.014110:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+66:11571:x1869685665656064:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783071438.014216:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+66:11571:x1869685665656064:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.014233:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 226 00000100:00100000:2.0:1783071438.016561:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071438.016718:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656192 00000100:00100000:1.0:1783071438.016728:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656192 00000100:00100000:1.0:1783071438.016787:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1783071438.016797:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:11571:x1869685665656192:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071438.016815:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071438.016845:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac81 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.016879:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.016888:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071438.016892:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071438.016897:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.016930:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.016941:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071438.016954:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684506368:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071438.017050:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c307f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071438.020388:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684506368:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071438.020457:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.020480:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2000, rc 0) 00000100:00100000:1.0:1783071438.020549:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:11571:x1869685665656192:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3752us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071438.020558:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:2.0:1783071438.025073:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.025169:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656320 00000100:00100000:0.0:1783071438.025180:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656320 00010000:00010000:0.0:1783071438.025233:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.025279:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:0.0:1783071438.025289:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2355:x1869685665656320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071438.025306:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071438.025340:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.025355:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.025378:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac7a expref: 12 pid: 6587 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.025396:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071438.025400:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071438.025409:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.025429:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.025466:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 11 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.025480:0:5775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7550e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684506496:192.168.202.16@tcp:105: 00000100:00100000:0.0:1783071438.025565:0:5775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.036908:0:5775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7550e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1869685684506496:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071438.036934:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071438.036995:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:2355:x1869685665656320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11706us (11929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.037025:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:3.0:1783071438.040540:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071438.040735:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656448 00000100:00100000:2.0:1783071438.040744:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656448 00002000:00100000:2.0:1783071438.040797:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9781c730f480 x1869685665656448/t0(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:29/0 lens 504/0 e 0 to 0 dl 1783071449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071438.040809:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c730f480 with x1869685665656448 ext(0->12) 00002000:00010000:2.0:1783071438.040815:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c730f480 00000100:00100000:2.0:1783071438.040848:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1783071438.040859:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+11:2357:x1869685665656448:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783071438.041321:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2357:x1869685665656448:12345-192.168.202.16@tcp:4:lhsmtool_posix.0 Request processed in 463us (791us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783071438.041330:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00002000:00100000:2.0:1783071438.041337:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9781c730f480 x1869685665656448/t4294967320(0) o4->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:29/0 lens 504/448 e 0 to 0 dl 1783071449 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071438.041356:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c730f480 with x1869685665656448 ext(0->12) 00002000:00010000:2.0:1783071438.041360:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c730f480 00000100:00100000:2.0:1783071438.047886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071438.047984:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656576 00000100:00100000:1.0:1783071438.047995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656576 00000100:00100000:1.0:1783071438.048054:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 227 00000100:00100000:1.0:1783071438.048063:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+66:11571:x1869685665656576:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783071438.111102:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+66:11571:x1869685665656576:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 63029us (63216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.111116:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 227 00000001:00080000:2.0:1783071438.112052:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:2.0:1783071438.112071:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783071438.112094:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782fb287f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1783071438.112099:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c66b2b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782fb287600 00000020:00080000:2.0:1783071438.112103:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782c66b2800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9782faf1a800 00000004:00080000:2.0:1783071438.112130:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783071438.112305:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1783071438.112413:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1783071438.112470:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1783071438.112495:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9781c779c780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1783071438.112499:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782cadbbc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9781c779cb40 00000100:00100000:3.0:1783071438.112951:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071438.112967:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684506624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783071438.113040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783071438.113322:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782cadbb300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9781c69af400 00000100:00100000:1.0:1783071438.113891:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071438.113907:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684506752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783071438.113952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783071438.114055:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1783071438.114257:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783071438.115372:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071438.115389:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684506880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783071438.115440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071438.115501:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684506624 00000100:00100000:0.0:1783071438.115508:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684506624 00000100:00080000:1.0:1783071438.115739:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783071438.115752:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684506752 00000100:00100000:0.0:1783071438.115756:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684506752 00000100:00100000:0.0:1783071438.115771:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684506880 00000100:00100000:0.0:1783071438.115774:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684506880 00000100:00100000:0.0:1783071438.115788:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783071438.115796:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1869685684506624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783071438.115824:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1783071438.115850:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.115871:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.115878:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783071438.115882:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783071438.115886:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.115913:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.115945:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 12 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.115958:0:6588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684507008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071438.116031:0:6588:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.116047:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783071438.116054:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1869685684506752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783071438.116202:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783071438.116206:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783071438 00002000:00010000:0.0:1783071438.116208:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783071438.116210:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783071438 -> 1783071438 00002000:00010000:0.0:1783071438.116211:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783071438.116265:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1869685684506752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (2312us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783071438.116273:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1783071438.116313:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9781c730c000/2, rc 0, transno 4294967321 00000100:00100000:3.0:1783071438.116317:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783071438.116319:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684506752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783071438.116326:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1869685684506880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783071438.116339:0:6585:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1783071438.116363:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4782cd, atime: 0x6a4782cd, ctime: 0x6a4782cd, blocks: 0x1 00010000:00010000:3.0:1783071438.116370:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.116379:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1783071438.116382:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071438.116387:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.116410:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.116422:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.116429:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.116451:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071438.117103:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071438.117108:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.117115:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071438.117118:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.117125:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.117146:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.117151:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6589d87/0xd360fc6ce6ec80c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.117166:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071438.117167:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071438.117168:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071438.120792:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1869685684506880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4458us (5342us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783071438.120806:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1783071438.121097:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9781c7550e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783071438.121104:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684506880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783071438.121936:0:6588:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6588:1869685684507008:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071438.121962:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.130483:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071438.130587:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656704 00000100:00100000:1.0:1783071438.130596:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656704 00010000:00010000:1.0:1783071438.130638:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 13 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071438.130714:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:1.0:1783071438.130724:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+13:2357:x1869685665656704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071438.130738:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071438.130744:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 13 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.130757:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 13 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.130781:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002992b2ee/0xd360fc6ce6ec7e83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabe0 expref: 13 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.130822:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071438.130826:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071438.130833:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.130842:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.130868:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071438.130992:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2357:x1869685665656704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071438.130999:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00010000:00010000:0.0:1783071438.131086:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.131097:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.131108:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.131115:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.131142:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783071438.131725:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3294:x1869685684506624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15927us (18683us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1783071438.131735:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1783071438.131793:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9781c730df80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1783071438.131803:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684506624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783071438.132253:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071438.132261:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.132289:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071438.132293:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.132304:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.132321:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.132329:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4f636c/0xd360fc6ce6ec80c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.132357:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071438.132359:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071438.132361:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071438.133809:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.133865:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665656832 00000100:00100000:0.0:1783071438.133875:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665656832 00000100:00100000:0.0:1783071438.133942:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1783071438.133952:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+12:2355:x1869685665656832:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783071438.196567:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1783071438.196613:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1783071438.196623:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1783071438.200135:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2355:x1869685665656832:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 66170us (66320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.200169:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:1.0:1783071438.211903:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.212259:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657088 00000100:00100000:3.0:1783071438.212342:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657088 00000100:00100000:3.0:1783071438.212453:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:3.0:1783071438.212465:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11571:x1869685665657088:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783071438.212523:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071438.212552:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939200/0xd360fc6ce6ec80ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac73 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.212574:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:3.0:1783071438.212579:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783071438.212610:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.212623:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.212658:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783071438.215182:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084943898 reply state 00000000ba1bc02c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.215200:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783071438.215350:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:11571:x1869685665657088:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 2885us (3521us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1783071438.215360:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 228 00000100:00100000:2.0:1783071438.225670:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.225786:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657216 00000100:00100000:0.0:1783071438.225797:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657216 00000100:00100000:0.0:1783071438.225865:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1783071438.225876:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665657216:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783071438.226152:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783071438.226157:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783071438 -> 1783071437 00002000:00010000:0.0:1783071438.226159:0:6585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783071437 00002000:00010000:0.0:1783071438.226162:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783071438 -> 1783071437 00002000:00010000:0.0:1783071438.226164:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1783071438.226206:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.226217:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.226235:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.226239:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665657216:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 364us (580us total) trans 4294967323 rc 0/0 00010000:00010000:3.0:1783071438.226243:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217ce00 already unused, calling callback (ffffffffc21074f0) 00000100:00100000:0.0:1783071438.226247:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00010000:00010000:3.0:1783071438.226248:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.226255:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.226344:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:3.0:1783071438.226347:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071438.226351:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.226371:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec80cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071438.232917:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.233058:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657472 00000100:00100000:3.0:1783071438.233067:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657472 00000100:00100000:3.0:1783071438.233166:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:3.0:1783071438.233174:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:11571:x1869685665657472:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783071438.233322:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.233341:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.233361:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.234070:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.234085:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 20 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.234100:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684507136:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071438.234212:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071438.237735:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.237869:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657600 00000100:00100000:0.0:1783071438.237879:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657600 00010000:00010000:0.0:1783071438.237922:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.237965:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:0.0:1783071438.237976:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:2358:x1869685665657600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071438.237993:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071438.238001:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.238026:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.238071:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:0.0:1783071438.238076:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.238088:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.238096:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.238116:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071438.238187:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:2358:x1869685665657600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 212us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.238195:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00010000:00010000:3.0:1783071438.239867:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939e00/0xd360fc6ce6ec8090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac65 expref: 20 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.239912:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5793:1869685684507136:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071438.239934:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240113:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240121:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240158:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240167:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240174:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240180:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071438.240185:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240192:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240206:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:2.0:1783071438.240209:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783071438.240213:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.240229:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec80d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071438.240353:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11571:x1869685665657472:12345-192.168.202.16@tcp:55:lhsmtool_posix.0 Request processed in 7178us (7445us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783071438.240364:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 229 00000100:00100000:2.0:1783071438.245116:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.245201:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657728 00000100:00100000:3.0:1783071438.245211:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657728 00000100:00100000:3.0:1783071438.245309:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:3.0:1783071438.245320:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2358:x1869685665657728:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783071438.245367:0:8704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.245387:0:8704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.245408:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071438.245419:0:8704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783071438.245424:0:8704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.245463:0:8704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.245477:0:8704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 8 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.245521:0:8704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8704:1869685684507264:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071438.245605:0:8704:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.254868:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071438.255067:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665657856 00000100:00100000:1.0:1783071438.255076:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665657856 00010000:00010000:1.0:1783071438.255118:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 9 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071438.255160:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:1.0:1783071438.255171:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665657856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071438.255186:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071438.255207:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 9 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.255262:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 9 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.255287:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071438.255292:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783071438.255298:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.255309:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.255330:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071438.255405:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+9:2358:x1869685665657856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 235us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071438.255420:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00010000:00010000:3.0:1783071438.257139:0:8704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005864c518/0xd360fc6ce6ec80ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac81 expref: 8 pid: 6588 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.257163:0:8704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8704:1869685684507264:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071438.257188:0:8704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257305:0:8704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257336:0:8704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257367:0:8704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257529:0:8704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257539:0:8704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257546:0:8704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217ce00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071438.257550:0:8704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257559:0:8704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257576:0:8704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.257583:0:8704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74551a9/0xd360fc6ce6ec80dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071438.257899:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665657728:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 12579us (12792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.257909:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1783071438.260965:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071438.261056:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665658112 00000100:00100000:2.0:1783071438.261066:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665658112 00000100:00100000:2.0:1783071438.261151:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 230 00000100:00100000:2.0:1783071438.261162:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11571:x1869685665658112:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071438.261258:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261277:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261289:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261642:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261655:0:6976:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261664:0:6976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261794:0:6976:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.261827:0:6976:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 20 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071438.261842:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684507392:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071438.261923:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071438.267229:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.267492:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665658240 00000100:00100000:3.0:1783071438.267501:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665658240 00010000:00010000:3.0:1783071438.267536:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.267566:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1783071438.267573:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:2358:x1869685665658240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071438.267585:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071438.267595:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.267605:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 21 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.267624:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:3.0:1783071438.267636:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.267643:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.267648:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.267663:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071438.267726:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:2358:x1869685665658240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 153us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.267731:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00010000:00010000:2.0:1783071438.268819:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec809e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac6c expref: 20 pid: 5793 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071438.268835:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684507392:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071438.268852:0:6976:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.268860:0:6976:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071438.268863:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783071438.269048:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1783071438.269176:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1783071438.269206:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1783071438.269300:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684507520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783071438.269357:0:6976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071438.269541:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40bea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.269660:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684507520 00000100:00100000:0.0:1783071438.269666:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684507520 00000100:00100000:0.0:1783071438.269815:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783071438.269821:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684507520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783071438.269897:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684507520:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.269902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071438.269953:0:6976:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1783071438.269957:0:6976:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1783071438.269971:0:6976:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9781c730c000, transno 4294967321 00000004:00080000:3.0:1783071438.269982:0:6976:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9781c730df80, transno 4294967322 00000100:00100000:3.0:1783071438.269987:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684507520:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783071438.270545:0:6976:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1783071438.270943:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684507648:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783071438.270977:0:6976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071438.271000:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071438.271048:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684507648 00000100:00100000:2.0:1783071438.271053:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684507648 00000100:00100000:2.0:1783071438.271076:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783071438.271090:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6976:x1869685684507648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783071438.271245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6976:x1869685684507648:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (265us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1783071438.271253:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071438.271318:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6976:1869685684507648:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783071438.271352:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271360:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271365:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271377:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071438.271381:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271387:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271547:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782d9b38600) 00010000:00010000:3.0:1783071438.271551:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071438.271556:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271562:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938a00/0xd360fc6ce6ec80eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271985:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.271994:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272000:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272005:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071438.272008:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272014:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272036:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071438.272039:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071438.272350:0:6976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272365:0:6976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272385:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.272586:0:6976:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.272844:0:6976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684507776:192.168.202.16@tcp:105: 00000100:00100000:0.0:1783071438.273264:0:6976:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.276654:0:6976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6976:1869685684507776:192.168.202.16@tcp:105: 00010000:00010000:0.0:1783071438.276720:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276747:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939a00/0xd360fc6ce6ec802e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276778:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276791:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276802:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276813:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276819:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276825:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276831:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071438.276835:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276841:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276852:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071438.276855:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071438.276858:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276870:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276882:0:6976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276888:0:6976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276894:0:6976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276899:0:6976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071438.276902:0:6976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276907:0:6976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276916:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071438.276919:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783071438.276921:0:6976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.276926:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec80e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.277143:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11571:x1869685665658112:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 15981us (16184us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1783071438.277153:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 230 00000020:00080000:0.0:1783071438.277168:0:6976:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783071438.277972:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071438.277979:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071438.278628:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1783071438.278640:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071438.280260:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.280337:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665658368 00000100:00100000:3.0:1783071438.280347:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665658368 00000100:00100000:3.0:1783071438.280410:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:3.0:1783071438.280431:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11570:x1869685665658368:12345-192.168.202.16@tcp:49:lfs.0 00000100:00100000:3.0:1783071438.280573:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11570:x1869685665658368:12345-192.168.202.16@tcp:49:lfs.0 Request processed in 154us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.280581:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1783071438.284896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.284971:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665658624 00000100:00100000:0.0:1783071438.284981:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665658624 00000100:00100000:0.0:1783071438.285040:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:0.0:1783071438.285050:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+23:11571:x1869685665658624:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783071438.285790:0:5795:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783071438.285888:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1783071438.285936:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285952:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285963:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285971:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285977:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285983:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.285994:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783071438.286097:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:11571:x1869685665658624:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1209us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1783071438.286117:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000020:00080000:0.0:1783071438.286123:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783071438.286700:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071438.286708:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.286715:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071438.286727:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.286736:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.286749:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9782cc2b6600) 00010000:00010000:1.0:1783071438.286752:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071438.286756:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.286763:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec80f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071438.286779:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071438.286781:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071438.286783:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071438.293816:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071438.293907:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665658880 00000100:00100000:2.0:1783071438.293917:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665658880 00000100:00100000:2.0:1783071438.293982:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:2.0:1783071438.293993:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:11570:x1869685665658880:12345-192.168.202.16@tcp:58:lfs.0 00000040:00080000:2.0:1783071438.294262:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1783071438.294349:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:11570:x1869685665658880:12345-192.168.202.16@tcp:58:lfs.0 Request processed in 357us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071438.294357:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 231 00000100:00100000:2.0:1783071438.330476:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.330711:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659008 00000100:00100000:3.0:1783071438.330723:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659008 00000100:00100000:3.0:1783071438.330777:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 232 00000100:00100000:3.0:1783071438.330786:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+25:11573:x1869685665659008:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1783071438.330827:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071438.330847:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec8100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac88 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330916:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330933:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330944:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330958:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330965:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.330971:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.331304:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.331316:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 26 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.331325:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.331363:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 26 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.331399:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 26 pid: 6976 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071438.331529:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c730d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684507904:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071438.331647:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cb854780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071438.334627:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c730d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5792:1869685684507904:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071438.334713:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071438.336827:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071438.337791:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659264 00000100:00100000:3.0:1783071438.337803:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659264 00000100:00100000:3.0:1783071438.337907:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:3.0:1783071438.337918:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:5566:x1869685665659264:12345-192.168.202.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783071438.338161:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:5566:x1869685665659264:12345-192.168.202.16@tcp:35:ldlm_bl.0 Request processed in 244us (1343us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1783071438.338169:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1783071438.341078:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071438.341203:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659392 00000100:00100000:0.0:1783071438.341213:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659392 00010000:00010000:0.0:1783071438.341265:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 28 pid: 6976 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071438.341309:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:0.0:1783071438.341320:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:2357:x1869685665659392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071438.341338:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071438.341345:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 28 pid: 6976 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341358:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 28 pid: 6976 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341586:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2800/0xd360fc6ce6ec8020 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac49 expref: 28 pid: 6976 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341669:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071438.341782:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341793:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341800:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071438.341843:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071438.341906:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+27:2357:x1869685665659392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 587us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071438.341914:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00010000:00010000:3.0:1783071438.342794:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342805:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071438.342851:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783071438.342856:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071438.342875:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342887:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342898:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342914:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342922:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342928:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071438.342932:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342941:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342953:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071438.342956:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071438.342960:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342966:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c800/0xd360fc6ce6ec8107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342983:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342989:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.342995:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343001:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071438.343009:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343016:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343025:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9782d9936800) 00010000:00010000:3.0:1783071438.343028:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071438.343031:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343037:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c400/0xd360fc6ce6ec810e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343079:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec8100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac88 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343092:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac88 expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071438.343100:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071438.343102:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071438.343104:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217d000, rc 0) 00000100:00100000:3.0:1783071438.343166:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11573:x1869685665659008:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 12380us (12702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071438.343174:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 232 00010000:00010000:2.0:1783071439.008868:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071439.072931:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783071439.072955:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684508032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783071439.073038:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071439.076523:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508032 00000100:00100000:0.0:1783071439.076537:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508032 00000100:00100000:0.0:1783071439.076624:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071439.076636:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3295:x1869685684508032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071439.076693:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071439.076779:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3295:x1869685684508032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071439.076786:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1783071439.076979:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071439.077024:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684508032:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783071439.189867:0:12417:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071439.189878:0:12417:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071439.189938:0:12417:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1783071439.189945:0:12417:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783071439.331694:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071439.331703:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071439.331745:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1783071439.331761:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071439.332178:0:11535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c7550380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684508160:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071439.332278:0:11535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c779c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783071439.339248:0:11535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c7550380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1869685684508160:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783071439.340742:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071439.340836:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659520 00000100:00100000:1.0:1783071439.340846:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659520 00000100:00100000:1.0:1783071439.340918:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00100000:1.0:1783071439.340939:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11585:x1869685665659520:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783071439.340974:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783071439.341072:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11585:x1869685665659520:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 134us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071439.341080:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 233 00000100:00080000:2.0:1783071439.341606:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071439.348894:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071439.348951:0:6976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659776 00000100:00100000:0.0:1783071439.348963:0:6976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659776 00000100:00100000:0.0:1783071439.349057:0:6976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:0.0:1783071439.349067:0:6976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+26:11585:x1869685665659776:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783071439.349089:0:6976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071439.349117:0:6976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec811c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac8f expref: -99 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071439.349250:0:6976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec8123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071439.349265:0:6976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec8123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071439.349276:0:6976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec8123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6976 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071439.349288:0:6976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783071439.349437:0:6976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8c00/0xd360fc6ce6ec811c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac8f expref: 29 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071439.349465:0:6976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec8123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac8f expref: 28 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071439.349475:0:6976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071439.349478:0:6976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783071439.349482:0:6976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8200, rc 0) 00000100:00100000:0.0:1783071439.349544:0:6976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:11585:x1869685665659776:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 479us (661us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1783071439.349551:0:6976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 234 00000100:00100000:1.0:1783071439.352529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071439.352605:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071439.352735:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660160 00000100:00100000:2.0:1783071439.352744:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660160 00000100:00100000:2.0:1783071439.352813:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 235 00000100:00100000:2.0:1783071439.352823:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:11585:x1869685665660160:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071439.352900:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.352918:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.352930:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353142:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353150:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353157:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353163:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071439.353167:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353174:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353187:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:2.0:1783071439.353191:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783071439.353195:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071439.353222:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938400/0xd360fc6ce6ec8131 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071439.353382:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:11585:x1869685665660160:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 559us (862us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783071439.353391:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 235 00000040:00080000:0.0:1783071439.353523:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071439.353529:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783071439.353564:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665659904 00000100:00100000:3.0:1783071439.353569:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665659904 00000100:00100000:3.0:1783071439.353613:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1783071439.353620:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:2357:x1869685665659904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071439.353637:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071439.353651:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8200/0xd360fc6ce6ec8123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac8f expref: 29 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071439.353662:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071439.353665:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071439.353707:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:2357:x1869685665659904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 88us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.353714:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000040:00080000:0.0:1783071439.354767:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1783071439.354782:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783071439.357891:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071439.358016:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660416 00000100:00100000:3.0:1783071439.358027:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660416 00000100:00100000:3.0:1783071439.358091:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1783071439.358103:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+28:11585:x1869685665660416:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783071439.358360:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:11585:x1869685665660416:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 258us (478us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783071439.358368:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:3.0:1783071439.585491:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071439.585512:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684508288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071439.585585:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071439.585668:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684508672:0@lo:400:kworker.0 00000100:00100000:3.0:1783071439.585714:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071439.585737:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071439.585742:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684508800:0@lo:400:kworker.0 00000100:00100000:3.0:1783071439.585760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071439.585827:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508288 00000100:00100000:2.0:1783071439.585834:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508288 00000100:00100000:1.0:1783071439.585864:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508672 00000100:00100000:1.0:1783071439.585870:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508672 00000100:00100000:2.0:1783071439.585887:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783071439.585899:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684508288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071439.585910:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508800 00000100:00100000:1.0:1783071439.585914:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508800 00002000:00000024:2.0:1783071439.585919:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1783071439.585948:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783071439.585958:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684508672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071439.585965:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684508288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071439.585973:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783071439.586001:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684508672:12345-0@lo:400:kworker.0 Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00080000:2.0:1783071439.586007:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071439.586011:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783071439.586030:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783071439.586089:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684508672:0@lo:400:kworker.0 00000100:00100000:3.0:1783071439.586117:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684508288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071439.586164:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684508800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071439.586204:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684508800:12345-0@lo:400:kworker.0 Request processed in 167us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.586259:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684508800:0@lo:400:kworker.0 00000100:00100000:0.0:1783071439.586325:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684508416:0@lo:400:kworker.0 00000100:00100000:0.0:1783071439.586367:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071439.586412:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071439.586418:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684508544:0@lo:400:kworker.0 00000100:00100000:0.0:1783071439.586440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071439.586464:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508544 00000100:00100000:0.0:1783071439.586468:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508544 00000100:00100000:3.0:1783071439.586519:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508416 00000100:00100000:3.0:1783071439.586523:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508416 00000100:00100000:3.0:1783071439.586550:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783071439.586556:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684508416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071439.586590:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684508416:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071439.586597:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783071439.591729:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684508416:0@lo:400:kworker.0 00000100:00100000:2.0:1783071439.591801:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783071439.591932:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783071439.591949:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684508544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071439.592053:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684508544:12345-0@lo:400:kworker.0 Request processed in 113us (5611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071439.592061:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783071439.592195:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684508544:0@lo:400:kworker.0 00010000:00010000:1.0:1783071440.033031:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783071440.143459:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1783071440.143481:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1783071440.143488:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1783071440.143494:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:0.0:1783071440.416903:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071440.416911:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071440.417072:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783071440.417079:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783071440.842634:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071440.842706:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071440.842752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071440.842779:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071440.842806:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071440.842843:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660544 00000100:00100000:2.0:1783071440.842854:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660544 00000100:00100000:2.0:1783071440.843152:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:2.0:1783071440.843174:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665660544:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071440.843267:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2358:x1869685665660544:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 95us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071440.843275:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:2.0:1783071440.843311:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660800 00000100:00100000:2.0:1783071440.843315:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660800 00000100:00100000:2.0:1783071440.843354:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660928 00000100:00100000:2.0:1783071440.843358:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660928 00000100:00100000:2.0:1783071440.843383:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1783071440.843390:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2358:x1869685665660800:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071440.843421:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2358:x1869685665660800:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071440.843427:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1783071440.843438:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1783071440.843444:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665660928:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071440.843466:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2358:x1869685665660928:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071440.843472:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1783071440.843754:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661056 00000100:00100000:2.0:1783071440.843759:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661056 00000100:00100000:2.0:1783071440.843797:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665660672 00000100:00100000:2.0:1783071440.843801:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665660672 00000100:00100000:2.0:1783071440.843821:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:2.0:1783071440.843829:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2358:x1869685665661056:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071440.843862:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2358:x1869685665661056:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071440.843868:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:2.0:1783071440.845222:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:2.0:1783071440.845235:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:2358:x1869685665660672:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071440.845297:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:2358:x1869685665660672:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 66us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071440.845303:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00080000:2.0:1783071440.847315:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783071440.847328:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783071440.847332:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783071440.855253:0:12469:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783071440.855263:0:12469:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071440.855312:0:12469:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783071440.855319:0:12469:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071441.048768:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071441.048806:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661312 00000100:00100000:0.0:1783071441.048815:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661312 00000100:00100000:0.0:1783071441.048865:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00100000:0.0:1783071441.048876:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+29:11606:x1869685665661312:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071441.048896:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071441.048914:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac96 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071441.049050:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec813f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071441.049065:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec813f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071441.049085:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec813f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071441.049097:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783071441.049241:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac96 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071441.049258:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec813f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac96 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071441.049266:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:0.0:1783071441.049269:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783071441.049272:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8a00, rc 0) 00000100:00100000:0.0:1783071441.049326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:11606:x1869685665661312:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 452us (570us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783071441.049334:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 236 00000100:00080000:0.0:1783071441.049360:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071441.053540:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071441.054447:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661440 00000100:00100000:3.0:1783071441.054458:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661440 00000100:00100000:3.0:1783071441.054507:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 237 00000100:00100000:3.0:1783071441.054516:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:11606:x1869685665661440:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1783071441.054583:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054601:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054612:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054649:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054656:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054698:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054705:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217ce00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071441.054709:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054717:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054728:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071441.054732:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783071441.054736:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071441.054743:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217ce00/0xd360fc6ce6ec814d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071441.054813:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+31:11606:x1869685665661440:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 297us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071441.054821:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 237 00010000:00010000:3.0:1783071441.057465:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071441.166879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071441.167023:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661568 00000100:00100000:2.0:1783071441.167034:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661568 00000100:00100000:2.0:1783071441.167096:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:2.0:1783071441.167107:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2356:x1869685665661568:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1783071441.167126:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071441.167147:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005abee58f/0xd360fc6ce6ec8154 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcac9d expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071441.167250:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a4782cd, atime: 0x6a4782cd, ctime: 0x6a4782cd, blocks: 0xb 00010000:00010000:2.0:1783071441.167274:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1783071441.167279:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071441.167304:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005abee58f/0xd360fc6ce6ec8154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac9d expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071441.167325:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005abee58f/0xd360fc6ce6ec8154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac9d expref: 8 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071441.167339:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071441.167400:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2356:x1869685665661568:12345-192.168.202.16@tcp:101:cat.0 Request processed in 295us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071441.167407:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:3.0:1783071441.177511:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071441.177580:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661696 00000100:00100000:0.0:1783071441.177592:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661696 00002000:00100000:0.0:1783071441.177660:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9781c730ca80 x1869685665661696/t0(0) o3->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:32/0 lens 488/0 e 0 to 0 dl 1783071452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783071441.177962:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c730ca80 with x1869685665661696 ext(0->4095) 00002000:00010000:0.0:1783071441.177971:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c730ca80 00000100:00100000:2.0:1783071441.178084:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1783071441.178099:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2356:x1869685665661696:12345-192.168.202.16@tcp:3:cat.0 00000100:00100000:2.0:1783071441.179012:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+8:2356:x1869685665661696:12345-192.168.202.16@tcp:3:cat.0 Request processed in 914us (1506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783071441.179032:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00002000:00100000:2.0:1783071441.179041:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9781c730ca80 x1869685665661696/t0(0) o3->2f53b2e5-d259-4f5f-95c9-4156e29b5f6a@192.168.202.16@tcp:32/0 lens 488/4536 e 0 to 0 dl 1783071452 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783071441.179051:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9781c730ca80 with x1869685665661696 ext(0->4095) 00002000:00010000:2.0:1783071441.179056:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9781c730ca80 00010000:00010000:2.0:1783071442.087112:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071443.105130:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783071443.231145:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1783071443.231165:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1783071443.270863:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1783071443.270926:0:5814:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9782cb854180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783071443.270932:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782fb2b7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9782cb854d80 00000020:00080000:2.0:1783071443.270946:0:5814:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9782fb2b7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9781c7085000 00000020:00080000:2.0:1783071443.270972:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1783071443.271013:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783071443.271214:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783071444.129048:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071444.194214:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684508928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071444.194288:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.194517:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684508928 00000100:00100000:0.0:1783071444.194540:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684508928 00000100:00100000:0.0:1783071444.194626:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071444.194636:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684508928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783071444.194695:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783071444.194747:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684508928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.194755:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071444.194803:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783071444.194809:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9782fa785180, transno 4294967307 00000004:00080000:0.0:1783071444.194819:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1783071444.194836:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9781c7550e00, transno 4294967310 00000100:00100000:0.0:1783071444.194847:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684508928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783071444.195602:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071444.706694:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684509312:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.706784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071444.706847:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783071444.706854:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684509184:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.706878:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071444.706909:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684509696:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.706935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071444.706971:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509312 00000100:00100000:1.0:1783071444.706979:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509312 00000100:00100000:1.0:1783071444.707027:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509184 00000100:00100000:1.0:1783071444.707030:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509184 00000100:00100000:1.0:1783071444.707050:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783071444.707058:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684509312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.707122:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684509312:12345-0@lo:400:kworker.0 Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.707130:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783071444.707147:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783071444.707153:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684509184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.707192:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684509184:12345-0@lo:400:kworker.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.707198:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1783071444.707215:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071444.707244:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684509184:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.707254:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684509312:0@lo:400:kworker.0 00000100:00100000:0.0:1783071444.707438:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684509056:0@lo:400:kworker.0 00000100:00100000:0.0:1783071444.707477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.707509:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684509568:0@lo:400:kworker.0 00000100:00100000:0.0:1783071444.707532:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.707552:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783071444.707558:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684509440:0@lo:400:kworker.0 00000100:00100000:0.0:1783071444.707580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071444.707602:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509568 00000100:00100000:0.0:1783071444.707606:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509568 00000100:00100000:0.0:1783071444.707637:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783071444.707642:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684509568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071444.707702:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684509568:12345-0@lo:400:kworker.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071444.707708:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1783071444.707725:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071444.707753:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684509568:0@lo:400:kworker.0 00000100:00100000:3.0:1783071444.708054:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509696 00000100:00100000:3.0:1783071444.708059:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509696 00000100:00100000:3.0:1783071444.708102:0:8704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509440 00000100:00100000:3.0:1783071444.708105:0:8704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509440 00000100:00100000:3.0:1783071444.708148:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071444.708155:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684509696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071444.708207:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684509696:12345-0@lo:400:kworker.0 Request processed in 53us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071444.708213:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071444.708226:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071444.708232:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684509440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071444.708266:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684509440:12345-0@lo:400:kworker.0 Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071444.708271:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071444.708314:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684509440:0@lo:400:kworker.0 00000100:00080000:0.0:1783071444.708497:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071444.708547:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509056 00000100:00100000:1.0:1783071444.708552:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509056 00000100:00100000:1.0:1783071444.708586:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783071444.708593:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684509056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.708638:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684509056:12345-0@lo:400:kworker.0 Request processed in 46us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.708645:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783071444.708705:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684509824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071444.708737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071444.708763:0:3295:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1783071444.708768:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1783071444.708800:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684509696:0@lo:400:kworker.0 00000100:00100000:1.0:1783071444.708822:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509824 00000100:00100000:1.0:1783071444.708826:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509824 00000100:00100000:1.0:1783071444.708847:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071444.708853:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684509824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071444.708924:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071444.708962:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684509824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071444.708968:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071444.708997:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684509824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071444.709141:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684509056:0@lo:400:kworker.0 00010000:00010000:3.0:1783071445.152960:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071445.945982:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071445.946141:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665661824 00000100:00100000:1.0:1783071445.946151:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665661824 00000100:00100000:1.0:1783071445.946240:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:1.0:1783071445.946251:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11259:x1869685665661824:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783071445.946842:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11259:x1869685665661824:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 124us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071445.946854:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 238 00000100:00100000:2.0:1783071445.948294:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071445.948530:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662080 00000100:00100000:1.0:1783071445.948540:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662080 00000100:00100000:1.0:1783071445.948596:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1783071445.948605:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:11259:x1869685665662080:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00080000:0.0:1783071445.949363:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071445.949403:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:11259:x1869685665662080:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 796us (1112us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1783071445.949413:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:3.0:1783071445.956722:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071445.956808:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071445.956842:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071445.956878:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071445.956907:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662592 00000100:00100000:3.0:1783071445.956916:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662592 00000100:00100000:3.0:1783071445.956974:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:3.0:1783071445.956984:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665662592:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071445.957106:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662464 00000100:00100000:1.0:1783071445.957110:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662464 00000100:00100000:1.0:1783071445.957140:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662336 00000100:00100000:1.0:1783071445.957143:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662336 00000100:00100000:1.0:1783071445.957176:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1783071445.957184:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665662464:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071445.957249:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665662464:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 66us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071445.957257:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1783071445.957274:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:1.0:1783071445.957280:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665662336:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071445.957304:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665662336:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071445.957310:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1783071445.957521:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c730ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2357:x1869685665662592:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 537us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071445.957539:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00080000:3.0:1783071445.957569:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783071445.957574:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783071445.957576:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071445.960785:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662208 00000100:00100000:2.0:1783071445.960798:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662208 00000100:00100000:2.0:1783071445.960951:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00100000:2.0:1783071445.960962:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665662208:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071445.961825:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665662208:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 862us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071445.961835:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 287 00000100:00100000:3.0:1783071446.147553:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071446.147662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662720 00000100:00100000:2.0:1783071446.147694:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662720 00000100:00100000:2.0:1783071446.147764:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 239 00000100:00100000:2.0:1783071446.147774:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:12057:x1869685665662720:12345-192.168.202.16@tcp:101:lsof.0 00010000:00010000:2.0:1783071446.147796:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071446.147817:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec815b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaca4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.147876:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.147890:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.147901:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071446.148194:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783071446.148198:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071446.148289:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.148314:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938600/0xd360fc6ce6ec815b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaca4 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.148331:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaca4 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071446.148339:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071446.148343:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071446.148346:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071446.148509:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:12057:x1869685665662720:12345-192.168.202.16@tcp:101:lsof.0 Request processed in 735us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071446.148517:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 239 00010000:00010000:2.0:1783071446.177295:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071447.201555:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071448.225958:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783071448.330034:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1783071448.330048:0:5814:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783071448.330102:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783071448.330114:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1783071449.097534:0:12673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:37:28 (1783071448) 00010000:00010000:3.0:1783071449.249279:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071449.319036:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684509952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071449.319110:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.319190:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684509952 00000100:00100000:3.0:1783071449.319198:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684509952 00000100:00100000:3.0:1783071449.319243:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783071449.319252:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684509952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071449.319288:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071449.319329:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684509952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.319336:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1783071449.319358:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783071449.319391:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684509952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071449.826158:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071449.826181:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684510464:0@lo:400:kworker.0 00000100:00100000:1.0:1783071449.826217:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684510336:0@lo:400:kworker.0 00000100:00100000:1.0:1783071449.826252:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071449.826252:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.826385:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684510592:0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.826416:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.826446:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684510208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.826469:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.826493:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510336 00000100:00100000:3.0:1783071449.826500:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510336 00000100:00100000:3.0:1783071449.826546:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510592 00000100:00100000:3.0:1783071449.826549:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510592 00000100:00100000:3.0:1783071449.826562:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510208 00000100:00100000:3.0:1783071449.826564:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510208 00000100:00100000:3.0:1783071449.826578:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783071449.826596:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684510336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.826645:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684510336:12345-0@lo:400:kworker.0 Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.826653:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783071449.826669:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783071449.826699:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684510592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.826730:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684510592:12345-0@lo:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.826736:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783071449.826748:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783071449.826754:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684510208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.826783:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684510208:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.826789:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1783071449.826807:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071449.827013:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684510336:0@lo:400:kworker.0 00000100:00100000:1.0:1783071449.827036:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684510848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071449.827062:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.827211:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684510592:0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.827244:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684510208:0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.827250:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684510720:0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.827271:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071449.827325:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510464 00000100:00100000:3.0:1783071449.827330:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510464 00000100:00100000:3.0:1783071449.827352:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510720 00000100:00100000:3.0:1783071449.827355:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510720 00000100:00100000:3.0:1783071449.827377:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783071449.827383:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c7551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684510464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.827426:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c7551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684510464:12345-0@lo:400:kworker.0 Request processed in 43us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.827433:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783071449.827444:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783071449.827450:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684510720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071449.827477:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684510720:12345-0@lo:400:kworker.0 Request processed in 28us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071449.827483:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1783071449.827499:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071449.827515:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684510720:0@lo:400:kworker.0 00000100:00100000:2.0:1783071449.828644:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510848 00000100:00100000:2.0:1783071449.828653:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510848 00000100:00100000:2.0:1783071449.828711:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071449.828720:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684510848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071449.828769:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071449.828834:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684510848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071449.828842:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071449.828886:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684510848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071449.831196:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684510464:0@lo:400:kworker.0 00000100:00100000:0.0:1783071449.831213:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684510080:0@lo:400:kworker.0 00000100:00100000:0.0:1783071449.831281:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071449.831391:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510080 00000100:00100000:2.0:1783071449.831399:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510080 00000100:00100000:2.0:1783071449.831449:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783071449.831458:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071449.831524:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684510080:12345-0@lo:400:kworker.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071449.831531:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783071449.831556:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684510080:0@lo:400:kworker.0 00010000:00010000:2.0:1783071450.273398:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071450.657708:0:11535:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783071450.657719:0:11535:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071450.658201:0:11535:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783071450.658208:0:11535:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783071451.072846:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.072898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.072967:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.073002:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.073031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071451.073083:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665663360 00000100:00100000:1.0:1783071451.073094:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665663360 00000100:00100000:2.0:1783071451.073202:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662848 00000100:00100000:2.0:1783071451.073207:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662848 00000100:00100000:2.0:1783071451.073250:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:2.0:1783071451.073260:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665662848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071451.073355:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2357:x1869685665662848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 96us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071451.073363:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 289 00000100:00100000:2.0:1783071451.073796:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665662976 00000100:00100000:2.0:1783071451.073801:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665662976 00000100:00100000:2.0:1783071451.073840:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:2.0:1783071451.073848:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:2357:x1869685665662976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071451.073893:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:2357:x1869685665662976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071451.073907:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00080000:2.0:1783071451.073934:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071451.074276:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:1.0:1783071451.074303:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2357:x1869685665663360:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071451.074350:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782facfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2357:x1869685665663360:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071451.074356:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00080000:2.0:1783071451.074768:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071451.075527:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665663104 00000100:00100000:3.0:1783071451.075536:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665663104 00000100:00100000:3.0:1783071451.075624:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665663232 00000100:00100000:3.0:1783071451.075628:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665663232 00000100:00080000:0.0:1783071451.075691:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071451.075694:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783071451.075747:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1783071451.075758:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665663104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071451.075822:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2357:x1869685665663104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 66us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071451.075830:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1783071451.075844:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:2.0:1783071451.075851:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665663232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071451.075890:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2357:x1869685665663232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 40us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071451.075897:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00010000:00010000:3.0:1783071451.297552:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071451.860605:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071451.860777:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665663616 00000100:00100000:2.0:1783071451.860789:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665663616 00000100:00100000:2.0:1783071451.860848:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:2.0:1783071451.860858:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+18:12278:x1869685665663616:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:2.0:1783071451.861935:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:12278:x1869685665663616:12345-192.168.202.16@tcp:35:umount.0 Request processed in 1074us (1336us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783071451.861946:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1783071451.875830:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071451.875932:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665663872 00000100:00100000:1.0:1783071451.875943:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665663872 00000100:00100000:1.0:1783071451.876003:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1783071451.876013:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+19:12278:x1869685665663872:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:1.0:1783071451.876401:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:12278:x1869685665663872:12345-192.168.202.16@tcp:35:umount.0 Request processed in 388us (889us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1783071451.876409:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1783071451.880883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071451.881037:0:11813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665664128 00000100:00100000:2.0:1783071451.881047:0:11813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665664128 00000100:00100000:2.0:1783071451.881109:0:11813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1783071451.881130:0:11813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782d698d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+20:12278:x1869685665664128:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:2.0:1783071451.881865:0:11813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782d698d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:12278:x1869685665664128:12345-192.168.202.16@tcp:35:umount.0 Request processed in 734us (989us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783071451.881874:0:11813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1783071451.887076:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071451.887202:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665664384 00000100:00100000:3.0:1783071451.887212:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665664384 00000100:00100000:3.0:1783071451.887267:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1783071451.887287:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+21:12278:x1869685665664384:12345-192.168.202.16@tcp:35:umount.0 00000100:00100000:3.0:1783071451.888077:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:12278:x1869685665664384:12345-192.168.202.16@tcp:35:umount.0 Request processed in 799us (1008us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1783071451.888083:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1783071451.898924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.898998:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.899032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071451.899077:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071451.899145:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665664896 00000100:00100000:1.0:1783071451.899155:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665664896 00000100:00100000:1.0:1783071451.899214:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665665152 00000100:00100000:1.0:1783071451.899218:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665665152 00000100:00100000:1.0:1783071451.899231:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665665024 00000100:00100000:1.0:1783071451.899234:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665665024 00000100:00100000:1.0:1783071451.899251:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1783071451.899263:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+15:2356:x1869685665664896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071451.899291:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071451.899323:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef0000/0xd360fc6ce6ec7178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca82f expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071451.899342:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071451.899411:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+14:2356:x1869685665664896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071451.899426:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1783071451.899457:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071451.899463:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+13:2356:x1869685665665152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071451.899471:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071451.899480:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b9000/0xd360fc6ce6ec73c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8fa expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071451.899816:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071451.899839:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:2356:x1869685665665152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 376us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071451.899847:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071451.899863:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1783071451.899869:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:2356:x1869685665665024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783071451.899877:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071451.899886:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec7140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca7f7 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071451.899894:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071451.899912:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665665024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 44us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071451.899918:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1783071451.899939:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665664768 00000100:00100000:1.0:1783071451.899943:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665664768 00000100:00100000:1.0:1783071451.899970:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:1.0:1783071451.899976:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2354:x1869685665664768:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:1.0:1783071451.900010:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7713 00000020:00010000:1.0:1783071451.900018:0:6587:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9782cd36b800: total 0 00000100:00080000:1.0:1783071451.900022:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9782cd338800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783071451.900062:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1783071451.900297:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782f9d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2354:x1869685665664768:12345-192.168.202.16@tcp:9:umount.0 Request processed in 320us (1382us total) trans 0 rc 0/0 00000020:00010000:2.0:1783071451.900409:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9782cd36b800: total 0 00010000:00010000:2.0:1783071451.900447:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9782cd36b800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1783071451.900492:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005abee58f/0xd360fc6ce6ec8154 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac9d expref: 5 pid: 6585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071451.900527:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000747385a1/0xd360fc6ce6ec7ab6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaacf expref: 4 pid: 8704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071451.900543:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9782cd36b800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1783071451.900554:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071451.900556:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071451.900558:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071451.901631:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1783071451.909988:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071451.910067:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665665280 00000100:00100000:2.0:1783071451.910077:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665665280 00000100:00100000:2.0:1783071451.910137:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:2.0:1783071451.910147:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+5:2354:x1869685665665280:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:2.0:1783071451.910180:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec74b2 00000100:00080000:2.0:1783071451.910189:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9782c3010800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071451.910236:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783071451.910545:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+2:2354:x1869685665665280:12345-192.168.202.16@tcp:9:umount.0 Request processed in 399us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071451.910553:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00010000:00010000:3.0:1783071451.911004:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071451.921245:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071451.921370:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665666304 00000100:00100000:2.0:1783071451.921381:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665666304 00000100:00100000:2.0:1783071451.921459:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 240 00000100:00100000:2.0:1783071451.921470:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+22:2354:x1869685665666304:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1783071451.921530:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec714e 00000020:00010000:2.0:1783071451.921547:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9782c2ecf800: total 0 00000100:00080000:2.0:1783071451.921552:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071451.921583:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1783071451.921893:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9782c2ecf800: total 0 00010000:00010000:3.0:1783071451.921899:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071451.921946:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9782c2ecf800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783071451.922028:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071451.922045:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071451.922056:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1e00/0xd360fc6ce6ec7e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcabc4 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922080:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071451.922083:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783071451.922088:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0800/0xd360fc6ce6ec7775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca9f6 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922102:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782cc2b6b00) 00010000:00010000:3.0:1783071451.922105:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071451.922120:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec7418 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca908 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922142:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071451.922145:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071451.922150:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8600/0xd360fc6ce6ec7997 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaa82 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922164:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9782d9936700) 00010000:00010000:3.0:1783071451.922167:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071451.922171:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef1600/0xd360fc6ce6ec7488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca924 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922201:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071451.922204:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071451.922208:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938c00/0xd360fc6ce6ec8035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac50 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922235:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9782c4fab200) 00010000:00010000:3.0:1783071451.922238:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783071451.922242:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec7b34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaf2 expref: 15 pid: 6976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922259:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:3.0:1783071451.922262:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783071451.922265:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3e00/0xd360fc6ce6ec7b18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaeb expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922278:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782cc2b6c00) 00010000:00010000:3.0:1783071451.922280:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071451.922285:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec7434 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca90f expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922299:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071451.922301:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783071451.922305:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8a00/0xd360fc6ce6ec813f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac96 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922317:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071451.922319:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071451.922323:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c4ef0c00/0xd360fc6ce6ec7a77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaaba expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922334:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9782d9936300) 00010000:00010000:3.0:1783071451.922337:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783071451.922347:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec7aa1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaac8 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922364:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9782c4fab500) 00010000:00010000:3.0:1783071451.922367:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071451.922371:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d000/0xd360fc6ce6ec8115 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcac88 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071451.922387:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9782c2ecf800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1783071451.922400:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071451.922402:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071451.922403:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071451.923263:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f53b2e5-d259-4f5f-95c9-4156e29b5f6a+7:2354:x1869685665666304:12345-192.168.202.16@tcp:39:umount.0 Request processed in 1791us (2026us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1783071451.923276:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 240 00010000:00010000:3.0:1783071452.321197:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071453.344861:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071453.382823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071453.382875:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071453.382913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071453.383004:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665666432 00000100:00100000:2.0:1783071453.383014:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665666432 00000100:00100000:2.0:1783071453.383063:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665666560 00000100:00100000:2.0:1783071453.383066:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665666560 00000100:00100000:2.0:1783071453.383075:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665666688 00000100:00100000:2.0:1783071453.383077:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665666688 00000100:00100000:2.0:1783071453.383094:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1783071453.383112:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+12:2355:x1869685665666432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071453.383129:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071453.383147:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef1000/0xd360fc6ce6ec7220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca844 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.383164:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071453.383216:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+11:2355:x1869685665666432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.383224:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1783071453.383239:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071453.383259:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+10:2356:x1869685665666560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071453.383267:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071453.383276:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef0a00/0xd360fc6ce6ec7227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca86e expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.383285:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071453.383304:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+9:2356:x1869685665666560:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.383310:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071453.383360:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1783071453.383367:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+8:2355:x1869685665666688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071453.383375:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071453.383388:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec73bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca8f3 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.383397:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071453.383420:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5670ebf1-2342-40c4-8ac4-3a3856f168dd+7:2355:x1869685665666688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 53us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071453.383427:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1783071453.397888:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071453.398033:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665666944 00000100:00100000:3.0:1783071453.398043:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665666944 00000100:00100000:3.0:1783071453.398152:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00100000:3.0:1783071453.398164:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+6:2354:x1869685665666944:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:3.0:1783071453.398205:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7235 00000020:00010000:3.0:1783071453.398214:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9782f9ba3000: total 0 00000100:00080000:3.0:1783071453.398219:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783071453.398249:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1783071453.398489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b05f6892-fe62-4bbe-88b4-45795cda05e5+5:2354:x1869685665666944:12345-192.168.202.16@tcp:39:umount.0 Request processed in 327us (610us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783071453.398497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 241 00000100:00080000:0.0:1783071453.399040:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1783071453.399096:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9782f9ba3000: total 0 00010000:00010000:2.0:1783071453.399156:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9782f9ba3000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783071453.399188:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071453.399192:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783071453.399201:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaca4 expref: 4 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.399226:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9782f9ba3000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1783071453.399252:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.399254:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.399256:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071453.417616:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071453.418011:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667200 00000100:00100000:0.0:1783071453.418022:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667200 00000100:00100000:0.0:1783071453.418070:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 290 00000100:00100000:0.0:1783071453.418080:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+7:2354:x1869685665667200:12345-192.168.202.16@tcp:251:umount.0 00000020:00000080:0.0:1783071453.418130:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec712b 00000020:00010000:0.0:1783071453.418138:0:5785:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9782c2ec8800: total 0 00000100:00080000:0.0:1783071453.418142:0:5785:0:(import.c:65:import_set_state_nolock()) ffff9782c2ec9000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1783071453.420434:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9782c2ec8800: total 0 00010000:00010000:2.0:1783071453.420445:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.420502:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9782c2ec8800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783071453.420541:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef0600/0xd360fc6ce6ec717f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bca836 expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071453.420561:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9782c2ec8800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1783071453.420579:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.420582:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071453.420584:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071453.421234:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5670ebf1-2342-40c4-8ac4-3a3856f168dd+1:2354:x1869685665667200:12345-192.168.202.16@tcp:251:umount.0 Request processed in 3151us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071453.421248:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 290 00000020:00000080:0.0:1783071453.421262:0:5785:0:(genops.c:906:class_export_put()) final put ffff9782c2ec8800/5670ebf1-2342-40c4-8ac4-3a3856f168dd 00000020:00000080:2.0:1783071453.422229:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c2ec8800/5670ebf1-2342-40c4-8ac4-3a3856f168dd for MGS 00000020:00000080:2.0:1783071453.422270:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c2ec9000 for MGS 00000001:00100000:0.0:1783071453.435695:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:0.0:1783071453.435705:0:7495:0:(genops.c:906:class_export_put()) final put ffff9782cd36b800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071453.435835:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9782cd36b800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-OST0001 00000020:00000080:1.0:1783071453.435888:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782cd338800 for lustre-OST0001 00000001:00080000:0.0:1783071453.438131:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:0.0:1783071453.438144:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000001:00080000:0.0:1783071453.438152:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1783071453.438161:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b05f6892-fe62-4bbe-88b4-45795cda05e5 00000001:00080000:0.0:1783071453.438167:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1783071453.438171:0:5814:0:(genops.c:906:class_export_put()) final put ffff9782f9ba3000/b05f6892-fe62-4bbe-88b4-45795cda05e5 00000020:00000080:0.0:1783071453.438264:0:5814:0:(genops.c:906:class_export_put()) final put ffff9782c2ecf800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:1.0:1783071453.438285:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ba3000/b05f6892-fe62-4bbe-88b4-45795cda05e5 for lustre-MDT0000 00000020:00000080:1.0:1783071453.438343:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782f9ba2000 for lustre-MDT0000 00000020:00000080:2.0:1783071453.438526:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c2ecf800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-MDT0000 00000020:00000080:2.0:1783071453.438632:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c2ec8000 for lustre-MDT0000 00010000:00010000:2.0:1783071454.368889:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071454.433063:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071454.433089:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684510976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071454.433175:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.433806:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684510976 00000100:00100000:3.0:1783071454.433817:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684510976 00000100:00100000:3.0:1783071454.433896:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783071454.433907:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684510976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783071454.433954:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071454.434009:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684510976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071454.434017:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783071454.434137:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684510976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783071454.434218:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071454.945568:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071454.945610:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684511104:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.945729:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684511360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.945736:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.945790:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684511488:0@lo:400:kworker.0 00000100:00100000:1.0:1783071454.945810:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684511616:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.946021:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684511232:0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.946191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.946205:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.946247:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511104 00000100:00100000:0.0:1783071454.946254:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511104 00000100:00100000:0.0:1783071454.946308:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1783071454.946317:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684511104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.946365:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c5ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684511104:12345-0@lo:400:kworker.0 Request processed in 49us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.946371:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783071454.946402:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511360 00000100:00100000:3.0:1783071454.946408:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511360 00000100:00100000:3.0:1783071454.946459:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071454.946466:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684511360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.946502:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684511360:12345-0@lo:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071454.946509:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783071454.946553:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684511360:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.946611:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511488 00000100:00100000:3.0:1783071454.946613:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684511872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071454.946617:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511488 00000100:00100000:3.0:1783071454.946647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.946656:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783071454.946665:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684511488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071454.946709:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511872 00000100:00100000:3.0:1783071454.946715:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511872 00000100:00100000:0.0:1783071454.946723:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684511488:12345-0@lo:400:kworker.0 Request processed in 60us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.946732:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783071454.946753:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1783071454.946758:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071454.946763:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684511872:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783071454.946766:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071454.946811:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684511488:0@lo:400:kworker.0 00000100:00100000:0.0:1783071454.946820:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684511104:0@lo:400:kworker.0 00002000:00000024:3.0:1783071454.946936:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071454.946971:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684511872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071454.946976:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783071454.947007:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684511872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071454.948037:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071454.948665:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511616 00000100:00100000:0.0:1783071454.948686:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511616 00000100:00100000:0.0:1783071454.948744:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071454.948755:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684511616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783071454.948891:0:5787:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071454.949052:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869685684511616:12345-0@lo:400:kworker.0 Request processed in 299us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.949060:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783071454.949278:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684511616:0@lo:400:kworker.0 00000020:01000004:3.0:1783071454.953719:0:12870:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:2.0:1783071454.954324:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.954371:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684511744:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.954412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.954462:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511232 00000100:00100000:2.0:1783071454.954470:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511232 00000100:00100000:2.0:1783071454.954533:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783071454.954545:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684511232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.954603:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684511232:12345-0@lo:400:kworker.0 Request processed in 61us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.954630:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783071454.954659:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684511744 00000100:00100000:2.0:1783071454.954663:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684511744 00000100:00100000:2.0:1783071454.954726:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071454.954736:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.954782:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684511744:12345-0@lo:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.954917:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783071454.954956:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684511232:0@lo:400:kworker.0 00000100:00100000:2.0:1783071454.954967:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684511744:0@lo:400:kworker.0 00000020:01000004:3.0:1783071454.963295:0:12870:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783071454.963344:0:12870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.963356:0:12870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.963362:0:12870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.963367:0:12870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.963387:0:12870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783071454.963392:0:12870:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783071454.963409:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783071454.963414:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783071454.963419:0:12870:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783071454.963441:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783071454.963461:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071454.963470:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071454.963480:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684512000:0@lo:39:umount.0 00010000:00010000:2.0:1783071454.963481:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef0400 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071454.963487:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071454.963497:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071454.963504:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071454.963511:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783071454.963514:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783071454.963517:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783071454.963559:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071454.963562:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071454.963580:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071454.963602:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071454.963610:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c4ef0400/0xd360fc6ce6ec71e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71e8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071454.963620:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071454.963621:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071454.963623:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071454.965658:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512000 00000100:00100000:0.0:1783071454.965670:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512000 00000100:00100000:0.0:1783071454.965839:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783071454.965850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869685684512000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783071454.965881:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6f3a 00000100:00080000:0.0:1783071454.965889:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9782d69f2800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783071454.965988:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3291:x1869685684512000:12345-0@lo:39:umount.0 Request processed in 140us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.965996:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1783071454.966008:0:5793:0:(genops.c:906:class_export_put()) final put ffff9782d69f6000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1783071454.966057:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071454.971459:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9ba3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783071454.971489:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684512000:0@lo:39:umount.0 00000020:00000080:0.0:1783071454.971527:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782d69f6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783071454.971582:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782d69f2800 for lustre-MDT0000 00000100:00080000:1.0:1783071454.972116:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783071454.972122:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783071454.972127:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1783071454.973098:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684512128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071454.973170:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783071454.973230:0:12870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973243:0:12870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973252:0:12870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973260:0:12870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973428:0:12870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071454.973437:0:12870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973445:0:12870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973452:0:12870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973458:0:12870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973472:0:12870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071454.973479:0:12870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973486:0:12870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973503:0:12870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973719:0:12870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973731:0:12870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783071454.973749:0:12870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973756:0:12870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973763:0:12870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973769:0:12870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071454.973777:0:12870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783071454.973780:0:12870:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783071454.973807:0:12870:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783071454.973811:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783071454.973816:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071454.973820:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783071454.973825:0:12870:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9781c6ce6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071454.973831:0:12870:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9782f9ea0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071454.973835:0:12870:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9782c5d4cd40) has exports, disconnecting them 00000020:00080000:1.0:1783071454.973846:0:12870:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9781c6ce6000), last request at 1783071454 00000020:00000080:1.0:1783071454.973853:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec70ad 00000100:00080000:1.0:1783071454.973869:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9781c5c53800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071454.973910:0:12870:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9781c6ce6000): rc 0 00000020:00000080:1.0:1783071454.973913:0:12870:0:(genops.c:906:class_export_put()) final put ffff9781c6ce6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783071454.973921:0:12870:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9782f9ea0000), last request at 1783071454 00000020:00000080:1.0:1783071454.973924:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6fd4 00000100:00080000:1.0:1783071454.973929:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9782f9ea6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071454.973935:0:12870:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9782f9ea0000): rc 0 00000020:00000080:1.0:1783071454.973937:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782f9ea0000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1783071454.973945:0:12870:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6bc02debae0 00000100:00080000:1.0:1783071454.973964:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783071454.973967:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1783071454.973980:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783071454.974036:0:12870:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783071454.974057:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9781c4990800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783071454.974071:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783071454.974074:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1783071454.974084:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783071454.974151:0:12870:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783071454.974160:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9782c6339000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:2.0:1783071454.974218:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c6ce6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1783071454.974423:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9782c5d4cd40) has no exports 00000020:00000080:2.0:1783071454.974613:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ea0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1783071454.974670:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512128 00000100:00100000:3.0:1783071454.974691:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512128 00000100:00100000:3.0:1783071454.974753:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783071454.974764:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3292:x1869685684512128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071454.974779:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071454.974800:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d7800/0xd360fc6ce6ec71e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec71e1 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.974825:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071454.974889:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:3292:x1869685684512128:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071454.974897:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783071454.974941:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783071454.974946:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.974955:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d6200 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071454.974958:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.974967:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071454.974973:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071454.974979:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071454.974982:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1783071454.974985:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1783071454.975006:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975015:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783071454.975015:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684512256:0@lo:9:umount.0 00010000:00010000:3.0:1783071454.975039:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975048:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d6200/0xd360fc6ce6ec71ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71f6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071454.975062:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071454.975070:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783071454.975075:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975081:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cea00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071454.975094:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975102:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071454.975108:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071454.975113:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071454.975115:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783071454.975118:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:1.0:1783071454.975121:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684512512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071454.975136:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975143:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783071454.975160:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071454.975162:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975169:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cea00/0xd360fc6ce6ec70e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec70ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975185:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071454.975188:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975200:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9600 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071454.975203:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975209:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071454.975215:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071454.975220:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783071454.975223:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783071454.975225:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783071454.975237:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975243:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071454.975249:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975255:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec73e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec73ee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.975265:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783071454.975404:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684512384:0@lo:9:umount.0 00000020:00000080:2.0:1783071454.975409:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c5c53800 for lustre-MDT0000 00000100:00100000:0.0:1783071454.975434:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071454.975528:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512256 00000100:00100000:1.0:1783071454.975534:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512256 00000020:00000080:2.0:1783071454.975535:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782f9ea6000 for lustre-MDT0000 00000100:00100000:1.0:1783071454.975570:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512384 00000100:00100000:1.0:1783071454.975574:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512384 00000100:00100000:1.0:1783071454.975613:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071454.975632:0:8704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783071454.975633:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869685684512256:12345-0@lo:9:umount.0 00000100:00100000:2.0:1783071454.975646:0:8704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869685684512384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783071454.975667:0:8704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7116 00000020:00000080:1.0:1783071454.975667:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec702f 00000100:00080000:2.0:1783071454.975695:0:8704:0:(import.c:65:import_set_state_nolock()) ffff9781c65c7000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783071454.975703:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9781c4a0a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783071454.975733:0:8704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000001:00000004:1.0:1783071454.975941:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1783071454.976177:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.976191:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217cc00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071454.976194:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.976213:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071454.976220:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071454.976225:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071454.976227:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783071454.976229:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783071454.976249:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.976254:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1783071454.976300:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c4990800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783071454.976318:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783071454.976320:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783071454.976325:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684512256:0@lo:9:umount.0 00000100:00080000:0.0:1783071454.976340:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782c6339000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1783071454.976350:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783071454.976350:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783071454.976354:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783071454.976359:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684512384:0@lo:9:umount.0 00010000:00010000:3.0:1783071454.976363:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff97830217cc00/0xd360fc6ce6ec6e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec6ea0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071454.976382:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071454.976385:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071454.976388:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071454.976404:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684512768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071454.976419:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071454.976433:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684512896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071454.976611:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3291:x1869685684512256:12345-0@lo:9:umount.0 Request processed in 975us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071454.976619:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071454.978012:0:8704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3291:x1869685684512384:12345-0@lo:9:umount.0 Request processed in 2355us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.978027:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071454.978030:0:8704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783071454.978157:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684512128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071454.978349:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512512 00000100:00100000:1.0:1783071454.978357:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512512 00000100:00100000:1.0:1783071454.978437:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512896 00000100:00100000:1.0:1783071454.978441:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512896 00000100:00100000:0.0:1783071454.978476:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071454.978487:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+19:3293:x1869685684512512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071454.978502:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071454.978601:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec71f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec71ef expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071454.978621:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071454.978665:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+18:3293:x1869685684512512:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.978692:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783071454.978708:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783071454.978715:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:3292:x1869685684512896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071454.978723:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071454.978731:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030400/0xd360fc6ce6ec6ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec6e99 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071454.978777:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071454.978814:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3292:x1869685684512896:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071454.978822:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783071454.978856:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3292:1869685684512896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071454.980544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.980598:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783071454.980610:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684512640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071454.980626:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512768 00000100:00100000:0.0:1783071454.980633:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512768 00000100:00100000:3.0:1783071454.980647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071454.980835:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684512512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071454.986828:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684512640 00000100:00100000:2.0:1783071454.986845:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684512640 00000100:00100000:2.0:1783071454.986913:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071454.986924:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+17:3295:x1869685684512768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071454.986965:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071454.986987:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c4ef1c00/0xd360fc6ce6ec73ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec73e7 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071454.987006:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071454.987166:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+16:3295:x1869685684512768:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (6625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.987175:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071454.987198:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783071454.987205:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+15:3295:x1869685684512640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071454.987213:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071454.987223:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cf600/0xd360fc6ce6ec70ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec70e5 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071454.987236:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071454.987261:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68e3cd25-c67d-4a78-96d1-ad55e0a83e15+14:3295:x1869685684512640:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (6613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071454.989236:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071454.989461:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684512768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071454.989488:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3295:1869685684512640:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783071455.012963:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9782c5d4cd40) has no exports 00000020:00000080:3.0:1783071455.089542:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6ef4 00000020:00000080:3.0:1783071455.089561:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c8962000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783071455.089576:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783071455.089687:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c8962000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783071455.090214:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071455.090225:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783071455.090229:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9782c5bb99c0) has no exports 00000020:00000080:2.0:1783071455.091291:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6eed 00000020:00000080:2.0:1783071455.091305:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782fd360800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783071455.091373:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071455.091381:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783071455.091384:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782fd366000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783071455.091387:0:12870:0:(genops.c:865:class_export_destroy()) destroying export ffff9782fd366000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783071455.091395:0:12870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783071455.091610:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782fd360800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783071455.092030:0:12870:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9781c5c2f720 - data ffff9782f7f3b6c0/ffff9781c5c35400 00000020:01000000:2.0:1783071455.092197:0:12870:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9782c7ecd180 - data ffff9782e35855e8/ffff9782f9b30000 00000001:00000004:2.0:1783071455.104162:0:12870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1783071455.210982:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783071455.210991:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783071455.211010:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783071455.211013:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783071455.211209:0:6681:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783071455.211214:0:6681:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1783071455.211224:0:6681:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783071455.213236:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783071455.213242:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783071455.213455:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783071455.213459:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783071455.216644:0:8046:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783071455.216653:0:8046:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1783071455.216696:0:8046:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783071455.271239:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6ebc 00000020:00000080:1.0:1783071455.271255:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782f9142000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783071455.273492:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6ed1 00000020:00000080:1.0:1783071455.273506:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c8961800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783071455.273848:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9142000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783071455.274206:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783071455.274213:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.274221:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783071455.274225:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9782c5d4b380) has no exports 00000004:01000000:1.0:1783071455.274462:0:12870:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783071455.274473:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec710f 00000020:00000080:1.0:1783071455.274479:0:12870:0:(genops.c:906:class_export_put()) final put ffff9781c65c3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783071455.274485:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783071455.274488:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.274494:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783071455.274497:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9782f9ec4d40) has no exports 00000020:00000080:1.0:1783071455.274504:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7108 00000020:00000080:1.0:1783071455.274508:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c633f800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783071455.275008:0:12870:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783071455.275014:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783071455.275018:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1783071455.275034:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783071455.275037:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783071455.275079:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.275099:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071455.275105:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec701a 00000020:00000080:1.0:1783071455.275112:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782fabc0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783071455.275116:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783071455.275119:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.275123:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783071455.275126:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9782fa303380) has no exports 00000020:00000080:1.0:1783071455.275130:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec7013 00000020:00000080:1.0:1783071455.275134:0:12870:0:(genops.c:906:class_export_put()) final put ffff9781c4997800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783071455.275511:0:12870:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783071455.275515:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783071455.275518:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783071455.275522:0:12870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783071455.275523:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783071455.275544:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.275549:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071455.275572:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.275575:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071455.275599:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6ed8 00000020:00000080:1.0:1783071455.275604:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c8961000/lustre-MDD0000_UUID 00000020:01000000:1.0:1783071455.275608:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783071455.275611:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.275614:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783071455.275617:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9782c5d499c0) has no exports 00000020:00000080:1.0:1783071455.275636:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.275639:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783071455.275643:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6edf 00000020:00000080:1.0:1783071455.275645:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c8967800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783071455.275653:0:12870:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c8344000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783071455.275656:0:12870:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c8344000 3 00000020:01000004:1.0:1783071455.275665:0:12870:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9782c8344000 from lustre-MDT0000 00000020:00000080:1.0:1783071455.275761:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.275766:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783071455.275769:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782f9144000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783071455.275772:0:12870:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9144000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783071455.275781:0:12870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783071455.275855:0:12870:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1783071455.275859:0:12870:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783071455.275861:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783071455.275864:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.275867:0:12870:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071455.275873:0:12870:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9782c5beb800 68e3cd25-c67d-4a78-96d1-ad55e0a83e15 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071455.275878:0:12870:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9782c5d48000) has exports, disconnecting them 00000020:00080000:1.0:1783071455.275882:0:12870:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9782c5beb800), last request at 1783071270 00000020:00000080:1.0:1783071455.275895:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6e7d 00000020:00010000:1.0:1783071455.275899:0:12870:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9782c5beb800: total 7 00000100:00080000:1.0:1783071455.275903:0:12870:0:(import.c:65:import_set_state_nolock()) ffff9782c5beb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783071455.275970:0:12870:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9782c5beb800): rc 0 00000020:00080000:1.0:1783071455.275974:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9782c5d48000) has no exports 00000100:00100000:0.0:1783071455.276125:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9782c51c1400:5785] 2 exiting: rc = 0 00000100:00100000:0.0:1783071455.276227:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9782c5c7e800:5783] 0 exiting: rc = 1 00000100:00100000:0.0:1783071455.276289:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9782c51c0400:5784] 1 exiting: rc = 0 00000020:00000080:0.0:1783071455.276326:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c8961800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783071455.276331:0:8:0:(genops.c:906:class_export_put()) final put ffff9782f9147800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783071455.276333:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9147800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783071455.276341:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783071455.276461:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c65c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783071455.276468:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c633f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783071455.276473:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c6339000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783071455.276477:0:8:0:(genops.c:906:class_export_put()) final put ffff9781c65c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783071455.276480:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c65c0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783071455.276483:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783071455.276520:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782fabc0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783071455.276525:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c4997800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783071455.276529:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c4990800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783071455.276532:0:8:0:(genops.c:906:class_export_put()) final put ffff9781c49eb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783071455.276534:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c49eb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783071455.276540:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783071455.276605:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c8961000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783071455.276608:0:8:0:(genops.c:906:class_export_put()) final put ffff9782f9146800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783071455.276610:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9146800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783071455.276614:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783071455.276769:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c8967800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1783071455.276916:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276925:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276931:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276937:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276943:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276952:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276958:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276966:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276972:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276978:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276984:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276990:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.276996:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277001:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277015:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277022:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277028:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277035:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277042:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277047:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277054:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277060:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277066:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277071:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277076:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277082:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277101:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277107:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277113:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277119:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277124:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277130:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277135:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277141:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277147:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277154:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277161:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277167:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277172:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277177:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277183:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277188:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277193:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277198:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277204:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277210:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277216:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277222:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277228:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277240:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277246:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277253:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277258:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277264:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277356:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277363:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277369:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277374:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277379:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277384:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277390:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277395:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277401:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.277407:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783071455.277804:0:12870:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783071455.277808:0:12870:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:2.0:1783071455.278362:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9782c5beb800: total 0 00010000:00010000:2.0:1783071455.278476:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9782c5beb800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1783071455.278508:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217d400/0xd360fc6ce6ec6f87 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec6f80 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278528:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b8e00/0xd360fc6ce6ec73e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec73d9 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278539:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939400/0xd360fc6ce6ec7194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec718d expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278549:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0031000/0xd360fc6ce6ec7212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec720b expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278560:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c13d6400/0xd360fc6ce6ec73d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec73cb expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278573:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec71a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec719b expref: 4 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278593:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030600/0xd360fc6ce6ec71be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec71b7 expref: 3 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278602:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec71cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd360fc6ce6ec71c5 expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071455.278612:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9782c5beb800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1783071455.278624:0:5778:0:(genops.c:906:class_export_put()) final put ffff9782c5beb800/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 00010000:00010000:2.0:1783071455.278777:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071455.278780:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071455.278781:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783071455.279115:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c5beb800/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 for MGS 00000020:00000080:0.0:1783071455.279485:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c5beb000 for MGS 00000020:01000000:1.0:1783071455.279989:0:12870:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9781c5c2fe40 - data ffff9782f7f3b798/ffff9781c5c34c00 00000020:01000000:1.0:1783071455.280125:0:12870:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9782c2f23cc0 - data ffff9782e5b90e58/ffff9782c625e800 00000020:00000080:1.0:1783071455.280741:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6e61 00000020:00000080:1.0:1783071455.280749:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782cac24000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783071455.280763:0:12870:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c8344000 from MGS, refs=2 00000020:01000004:1.0:1783071455.280766:0:12870:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c8344000 2 00000020:01000004:1.0:1783071455.280769:0:12870:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9782c8344000 from MGS 00000020:00000080:1.0:1783071455.280791:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071455.280797:0:12870:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783071455.280799:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782cac22800/MGS 00000020:00000080:1.0:1783071455.280802:0:12870:0:(genops.c:865:class_export_destroy()) destroying export ffff9782cac22800/MGS for MGS 00000020:01000000:1.0:1783071455.280807:0:12870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783071455.280859:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783071455.280863:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071455.280868:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071455.280875:0:12870:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9782f9ba4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071455.280880:0:12870:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9782f9ec0000) has exports, disconnecting them 00000020:00080000:1.0:1783071455.280894:0:12870:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9782f9ba4000), last request at 1783071270 00000020:00000080:1.0:1783071455.280898:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6f2c 00000020:00080000:1.0:1783071455.280908:0:12870:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9782f9ba4000): rc 0 00000020:00000080:1.0:1783071455.280912:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782f9ba4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783071455.281387:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782cac24000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783071455.281395:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ba4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783071455.282736:0:12870:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783071455.282743:0:12870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071455.282748:0:12870:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783071455.282755:0:12870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783071455.282874:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783071455.282881:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783071455.282886:0:12870:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c8344000 1 00000020:00000080:0.0:1783071455.282891:0:12870:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6e53 00000020:00000080:0.0:1783071455.282897:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782cac26000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783071455.282902:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783071455.282906:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783071455.282909:0:12870:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783071455.282911:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9782c67119c0) has no exports 00000020:00000080:2.0:1783071455.283017:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782f9ba3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783071455.283025:0:8:0:(genops.c:906:class_export_put()) final put ffff9782d69f2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783071455.283028:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782d69f2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783071455.283040:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783071455.283109:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782cac26000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783071455.314047:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783071455.314063:0:12870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783071455.314070:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c6649800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783071455.314075:0:12870:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c6649800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783071455.314096:0:12870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783071455.314241:0:12870:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9782c8345000 00000020:01000000:2.0:1783071455.314265:0:12870:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1783071455.314270:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071455.314275:0:12870:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783071455.314290:0:12870:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9782c5bbcd40) has no exports 00000100:00100000:2.0:1783071455.314365:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9782c3e2ca00:5792] 1 exiting: rc = 0 00000100:00100000:2.0:1783071455.314447:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9782c5c7f800:5791] 0 exiting: rc = 1 00000100:00100000:2.0:1783071455.314493:0:6976:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9781c429aa00:6976] 3 exiting: rc = 0 00000100:00100000:0.0:1783071455.314606:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9782c34a1600:5793] 2 exiting: rc = 0 00000100:00100000:2.0:1783071455.314812:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314820:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314825:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314831:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314836:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314841:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314847:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314852:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314858:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314865:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314871:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314876:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314881:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314886:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314892:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314897:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314905:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314911:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314916:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314922:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314927:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314932:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314938:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314943:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314949:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314955:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314962:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314968:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314974:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314980:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314985:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314991:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.314996:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315002:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315008:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315021:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315027:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315032:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315038:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315043:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315050:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315056:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315062:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315067:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315073:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315080:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315096:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315102:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315107:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315112:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315117:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315122:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315127:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315133:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315139:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315145:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315150:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315157:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315163:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315169:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315174:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315179:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315184:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.315189:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319180:0:11813:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9782fa42fc00:11813] 2 exiting: rc = 0 00000100:00100000:3.0:1783071455.319466:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9782c34a0600:5794] 0 exiting: rc = 1 00000100:00100000:0.0:1783071455.319775:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9782c3e2da00:5795] 1 exiting: rc = 0 00000100:00100000:2.0:1783071455.319879:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319888:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319894:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319899:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319905:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319920:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319926:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319932:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319937:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319943:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319948:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319954:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319960:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319966:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319971:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319976:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319985:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319992:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.319997:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320005:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320010:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320017:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320022:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320026:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320031:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320036:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320041:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320045:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320052:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320056:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320061:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320065:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320070:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320075:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320079:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320091:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320096:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320100:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320104:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320108:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320119:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320124:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320129:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320134:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320138:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320143:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320149:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320153:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320156:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320160:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320166:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320170:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320175:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320183:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320188:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320192:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320197:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320202:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320206:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320211:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320215:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320219:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320224:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320229:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320624:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9782d69eac00:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1783071455.320743:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9782d69ea800:5796] 0 exiting: rc = 1 00000100:00100000:2.0:1783071455.320827:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320833:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320840:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320846:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320852:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320857:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320864:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320869:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320874:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320880:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320893:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320913:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320919:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320924:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320929:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320935:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320940:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320946:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320952:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320957:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320963:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320968:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320973:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320990:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.320995:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321001:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321006:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321012:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321017:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321022:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321029:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321035:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321041:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321046:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321053:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321074:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321082:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321098:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321104:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321111:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321116:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321122:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321128:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321134:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321139:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321152:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321157:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321176:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321184:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321190:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321196:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321202:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321208:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321215:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321220:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321227:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321234:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321240:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321247:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321267:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321274:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321347:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321353:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.321359:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071455.328390:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9782d69ea600:5799] 1 exiting: rc = 0 00000100:00100000:0.0:1783071455.328390:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9782d69ea400:5798] 0 exiting: rc = 1 00000100:00100000:2.0:1783071455.344778:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344789:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344794:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344799:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344805:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344811:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344816:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344822:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344827:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344832:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344836:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344842:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344847:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344886:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344892:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344896:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344913:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344917:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344922:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344926:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344931:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344936:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344940:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344947:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344952:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344957:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344961:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344965:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344969:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344973:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344978:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344982:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344986:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344990:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344995:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.344999:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345006:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345011:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345015:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345020:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345024:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345028:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345032:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345036:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345040:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345044:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345048:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345052:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345056:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345061:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345064:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345073:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345078:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345091:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345096:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345100:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345105:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345109:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345114:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345118:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345122:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345127:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345131:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345135:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.345654:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9782d69eb000:5801] 1 exiting: rc = 0 00000100:00100000:2.0:1783071455.345891:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9782d69eb800:5800] 0 exiting: rc = 1 00000100:00100000:2.0:1783071455.345937:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345944:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345950:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345955:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345960:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345965:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345970:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345976:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345982:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345987:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345992:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.345998:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346003:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346008:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346013:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346019:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346026:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346031:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346036:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346041:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346046:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346061:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346067:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346071:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346077:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346094:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346100:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346106:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346111:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346116:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346122:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346128:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346133:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346138:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346144:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346149:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346154:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346160:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346166:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346171:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346178:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346184:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346189:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346194:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346199:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346205:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346210:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346215:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346220:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346226:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346231:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346237:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346242:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346247:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346253:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346258:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346270:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346283:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346289:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346295:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346300:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346305:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346311:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.346315:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071455.347342:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9782c34a0e00:5802] 0 exiting: rc = 1 00000100:00100000:0.0:1783071455.347461:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9782c34a1c00:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1783071455.347750:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347757:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347762:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347767:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347772:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347777:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347782:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347788:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347793:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347798:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347804:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347810:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347816:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347821:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347826:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347831:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347836:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347840:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347845:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347850:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347854:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347858:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347863:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347868:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347872:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347877:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347882:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347895:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347900:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347904:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347909:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347913:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347917:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347921:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347925:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347930:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347935:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347939:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347943:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347946:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347950:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347955:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347959:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347964:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347969:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.347974:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348023:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348031:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348035:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348040:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348044:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348049:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348053:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348057:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348062:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348066:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348071:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348076:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348081:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348096:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348101:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348105:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348116:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.348120:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071455.348779:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9782c51b3600:5805] 1 exiting: rc = 0 00000100:00100000:3.0:1783071455.348991:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9782c5b98a00:5806] 2 exiting: rc = 0 00000100:00100000:0.0:1783071455.349080:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9782c5c7f400:5804] 0 exiting: rc = 1 00000100:00100000:2.0:1783071455.349227:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349274:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349346:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349353:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349360:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349365:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349371:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349377:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349383:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349389:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349394:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349401:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349406:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349411:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349417:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349433:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349438:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349444:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349450:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349455:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349461:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349466:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349472:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349477:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349483:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349489:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349494:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349499:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349506:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349557:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349565:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349571:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349576:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349589:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349594:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349599:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349604:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349609:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349614:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349633:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349639:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349644:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349649:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349654:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349658:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349663:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.349668:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350409:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350419:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350424:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350430:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350436:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350441:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350449:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350455:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350460:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350466:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350472:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350477:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350481:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350486:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350492:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350496:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783071455.350501:0:12870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783071455.365940:0:12870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783071455.365953:0:12870:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783071455.365959:0:12870:0:(genops.c:906:class_export_put()) final put ffff9782c87c5000/MDS_uuid 00000020:00000080:0.0:1783071455.365963:0:12870:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c87c5000/MDS_uuid for MDS 00000020:01000000:0.0:1783071455.365968:0:12870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783071455.366125:0:12870:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783071455.472976:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071455.544958:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783071455.544968:0:6612:0:(genops.c:906:class_export_put()) final put ffff9781c4a0c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783071455.545001:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:2.0:1783071455.545004:0:6612:0:(genops.c:906:class_export_put()) final put ffff9782c3011800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a 00000020:00000080:0.0:1783071455.545122:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c4a0c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783071455.545166:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c3011800/2f53b2e5-d259-4f5f-95c9-4156e29b5f6a for lustre-OST0000 00000020:00000080:0.0:1783071455.545180:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c4a0a000 for lustre-OST0000 00000020:00000080:0.0:1783071455.545184:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c3010800 for lustre-OST0000 00010000:00010000:2.0:1783071456.481129:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071457.508529:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783071457.851639:0:13023:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783071457.864249:0:13023:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783071457.864570:0:13023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071457.864585:0:13023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071457.864593:0:13023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071457.864600:0:13023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071457.864627:0:13023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783071457.864633:0:13023:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783071457.864656:0:13023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783071457.864659:0:13023:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783071457.864664:0:13023:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783071457.864698:0:13023:0:(import.c:65:import_set_state_nolock()) ffff9781c49ef800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783071457.864784:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684513024:0@lo:39:umount.0 00000400:00000100:1.0:1783071457.864826:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685684513024 offset 0 length 224: 4 00010000:00010000:2.0:1783071457.865466:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071457.865475:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071457.865485:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071457.865489:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071457.865499:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071457.865506:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071457.865512:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783071457.865515:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783071457.865518:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783071457.865544:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071457.865552:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783071457.865572:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684513152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071457.865579:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071457.865589:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c0030800/0xd360fc6ce6ec71b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd360fc6ce6ec71be expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071457.865602:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071457.865604:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071457.865609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783071457.865617:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071457.865647:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684513152 00000100:00100000:3.0:1783071457.865652:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684513152 00000100:00100000:3.0:1783071457.865867:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071457.865873:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1869685684513152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783071457.865877:0:5775:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783071457 with bad export cookie 15231451484427939453 00000100:00100000:3.0:1783071457.875558:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1869685684513152:12345-0@lo:103:ldlm_bl.0 Request processed in 9676us (9941us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783071457.875572:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783071457.875634:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783071457.875640:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783071457.875644:0:3293:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783071457.887954:0:3293:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783071457.887961:0:3293:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783071457.887971:0:3293:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9781c51c4700 x1869685684513152/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783071473 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783071457.887986:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783071457.887989:0:3293:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783071457.887990:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783071457.887994:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071457.887998:0:3293:0:(import.c:512:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 171 00000100:00080000:1.0:1783071457.888007:0:3293:0:(import.c:626:import_select_connection()) MGC192.168.202.116@tcp: import ffff9782c87c3000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071457.888586:0:3293:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77caa00 x1869685684513280/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071457.888659:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684513280:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1783071457.888849:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3293:1869685684513152:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1783071457.889126:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685684513280 offset 0 length 520: 4 00010000:00010000:1.0:1783071458.530254:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783071458.580719:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783071458.580729:0:7495:0:(genops.c:906:class_export_put()) final put ffff9781c65c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783071458.580782:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c65c3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783071458.580831:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c65c7000 for lustre-OST0001 00010000:00010000:2.0:1783071459.552971:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071460.064883:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071460.064894:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783071460.065003:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684513408:0@lo:400:kworker.0 00000400:00000100:1.0:1783071460.065074:0:3294:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685684513408 offset 0 length 224: 4 00010000:00010000:1.0:1783071460.577257:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071461.600890:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071462.626384:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783071463.072795:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071463.072826:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071463.072950:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684513536:0@lo:400:kworker.0 00000400:00000100:0.0:1783071463.073007:0:3295:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685684513536 offset 0 length 224: 4 00010000:00010000:2.0:1783071463.649220:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071464.674407:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071465.696972:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071466.721729:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071467.233847:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071457/real 1783071457] req@ffff9781c77caa00 x1869685684513280/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071467.233878:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c77caa00 x1869685684513280/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783071467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071467.233889:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071457/real 1783071457] req@ffff9781c77c9180 x1869685684513024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071467.233925:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c77c9180 x1869685684513024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071467.233942:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071467.233969:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783071467.233974:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684513280:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1783071467.233980:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c49ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783071467.234005:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684513024:0@lo:39:umount.0 00000100:00080000:1.0:1783071467.234038:0:13023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783071467.234043:0:13023:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783071467.234048:0:13023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783071467.234143:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783071467.234149:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783071467.234152:0:8:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783071467.234156:0:8:0:(import.c:512:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 359 00000100:00080000:3.0:1783071467.234161:0:8:0:(import.c:591:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783071467.234168:0:8:0:(import.c:626:import_select_connection()) MGC192.168.202.116@tcp: import ffff9782c87c3000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1783071467.234207:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c4296a00 x1869685684513664/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783071467.234283:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783071467.234295:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684513792:0@lo:400:kworker.0 00000400:00000100:3.0:1783071467.234342:0:3293:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685684513792 offset 0 length 224: 4 00000100:00100000:0.0:1783071467.234538:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684513664:0@lo:250:kworker.0 00000400:00000100:0.0:1783071467.234559:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869685684513664 offset 0 length 520: 4 00010000:00010000:1.0:1783071467.241428:0:13023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241461:0:13023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241469:0:13023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241477:0:13023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241499:0:13023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071467.241506:0:13023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241513:0:13023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241520:0:13023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241526:0:13023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071467.241545:0:13023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783071467.241549:0:13023:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783071467.241573:0:13023:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783071467.241577:0:13023:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783071467.241582:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071467.241586:0:13023:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783071467.241590:0:13023:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9782c6713380) has no exports 00000020:00080000:1.0:1783071467.241618:0:13023:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9782c6713380) has no exports 00010000:00010000:3.0:1783071467.241619:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783071467.241627:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241635:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071467.241638:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241647:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071467.241655:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071467.241661:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071467.241669:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783071467.241686:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783071467.241699:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:3.0:1783071467.241703:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241711:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7938800/0xd360fc6ce6ec71c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec71cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241725:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071467.241728:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241734:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c4ef1800 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071467.241737:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241743:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071467.241750:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071467.241755:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783071467.241757:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783071467.241759:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783071467.241764:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:3.0:1783071467.241766:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241772:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1800/0xd360fc6ce6ec73d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec73e0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071467.241785:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071467.241787:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071467.241789:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071467.242077:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783071467.255779:0:13023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9781c5c2fc60 - data ffff9782f7f11510/ffff9781c5c34800 00000020:01000000:0.0:1783071467.255903:0:13023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9782c5c51780 - data ffff9782e373faf8/ffff9781c4b6c400 00100000:10000000:2.0:1783071467.266274:0:13023:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783071467.313914:0:13023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6fa3 00000020:00000080:1.0:1783071467.313924:0:13023:0:(genops.c:906:class_export_put()) final put ffff9782f9ea1000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783071467.313945:0:13023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782f9bac800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783071467.313948:0:13023:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782f9bac800 2 00000020:01000004:1.0:1783071467.313951:0:13023:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9782f9bac800 from lustre-OST0000 00000020:00000080:1.0:1783071467.313975:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071467.313985:0:13023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783071467.313998:0:13023:0:(genops.c:906:class_export_put()) final put ffff9782f9ea3000/lustre-OST0000_UUID 00000020:00000080:1.0:1783071467.314001:0:13023:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ea3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783071467.314013:0:13023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783071467.314057:0:13023:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783071467.314063:0:13023:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783071467.314067:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071467.314072:0:13023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783071467.314079:0:13023:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9781c49ec000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783071467.314085:0:13023:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9782c6714d40) has exports, disconnecting them 00000020:00080000:1.0:1783071467.314090:0:13023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9781c49ec000), last request at 1783071283 00000020:00000080:1.0:1783071467.314094:0:13023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6fcd 00000020:00080000:1.0:1783071467.314105:0:13023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9781c49ec000): rc 0 00000020:00000080:1.0:1783071467.314110:0:13023:0:(genops.c:906:class_export_put()) final put ffff9781c49ec000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783071467.314281:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9ea1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783071467.314300:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c49ec000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783071467.315773:0:13023:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783071467.315782:0:13023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071467.315786:0:13023:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783071467.315793:0:13023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783071467.315936:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783071467.315942:0:13023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1783071467.315949:0:13023:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782f9bac800 1 00000020:00000080:0.0:1783071467.315954:0:13023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6f5d 00000020:00000080:0.0:1783071467.315961:0:13023:0:(genops.c:906:class_export_put()) final put ffff9782e39ff800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783071467.316034:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c49ef800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783071467.316041:0:8:0:(genops.c:906:class_export_put()) final put ffff9781c4991800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783071467.316044:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c4991800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783071467.316055:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783071467.316146:0:13023:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783071467.316159:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783071467.316163:0:13023:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783071467.316167:0:13023:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9782c5bb8000) has no exports 00000020:00000080:3.0:1783071467.316307:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9782e39ff800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783071467.334951:0:13023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071467.334967:0:13023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783071467.334973:0:13023:0:(genops.c:906:class_export_put()) final put ffff9782f9baa800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783071467.334977:0:13023:0:(genops.c:865:class_export_destroy()) destroying export ffff9782f9baa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783071467.334983:0:13023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783071467.335111:0:13023:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9782f9bad800 00000020:02000400:3.0:1783071467.335169:0:13023:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783071467.744770:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071468.770117:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783071469.513125:0:13177:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783071469.521817:0:13177:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783071469.521900:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071469.521915:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071469.521924:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071469.521932:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071469.522017:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783071469.522023:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783071469.522045:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071469.522058:0:13177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9781c4294e00 x1869685684513408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071469.522078:0:13177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9781c4297800 x1869685684513536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071469.522094:0:13177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9781c4295880 x1869685684513792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071469.522106:0:13177:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783071469.522125:0:13177:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783071469.522150:0:13177:0:(import.c:65:import_set_state_nolock()) ffff9781c6ce4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783071469.525236:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1869685684513536:0@lo:400:kworker.0 00000100:00100000:0.0:1783071469.525286:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684513920:0@lo:39:umount.0 00000400:00000100:0.0:1783071469.525336:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869685684513920 offset 0 length 224: 4 00000100:00100000:1.0:1783071469.527597:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684513408:0@lo:400:kworker.0 00000100:00100000:1.0:1783071469.527642:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1869685684513792:0@lo:400:kworker.0 00010000:00010000:3.0:1783071469.529842:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071469.529855:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071469.529868:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030c00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071469.529873:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071469.529994:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071469.530019:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071469.530025:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071469.530028:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783071469.530031:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783071469.530049:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:3.0:1783071469.530053:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071469.530061:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c0030c00/0xd360fc6ce6ec718d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec7194 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071469.530074:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071469.530077:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071469.530078:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071469.793218:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071470.817870:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071471.840927:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071472.352782:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783071472.352793:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783071472.865188:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071473.889928:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071474.912849:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071475.937831:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071476.960897:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071477.473039:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783071477.473050:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783071477.986722:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071479.009130:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071479.715319:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071469/real 1783071469] req@ffff9781c51c4000 x1869685684513920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071479.715356:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c51c4000 x1869685684513920/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783071479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071479.715373:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c6ce4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783071479.715389:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684513920:0@lo:39:umount.0 00000100:00080000:2.0:1783071479.715458:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783071479.715463:0:13177:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783071479.715467:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783071479.716243:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716257:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716265:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716272:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716348:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071479.716355:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716360:0:13177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716364:0:13177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071479.716367:0:13177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719355:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071479.719366:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719376:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c13d7400 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071479.719380:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719388:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071479.719393:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071479.719396:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783071479.719398:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783071479.719409:0:5778:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:1.0:1783071479.719411:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719415:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c13d7400/0xd360fc6ce6ec719b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec71a2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719430:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071479.719432:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719436:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9400 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071479.719438:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719458:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071479.719462:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071479.719464:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783071479.719466:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783071479.719468:0:5778:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:1.0:1783071479.719471:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071479.719477:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071479.719478:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071479.719480:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071479.720645:0:13177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783071479.720658:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9400/0xd360fc6ce6ec73cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec73d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071479.720693:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1783071479.720700:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1783071479.720702:0:13177:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783071479.720733:0:13177:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783071479.720736:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783071479.720745:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783071479.720750:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783071479.720753:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9782f9ec3380) has no exports 00000020:00080000:2.0:1783071479.720776:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9782f9ec3380) has no exports 00010000:00010000:3.0:1783071479.721456:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783071479.725410:0:13177:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9781c5c2f840 - data ffff9782e3675510/ffff9782faca7c00 00000020:01000000:2.0:1783071479.725576:0:13177:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9782c9fb1540 - data ffff9782e37b0798/ffff9782f9c2cc00 00100000:10000000:2.0:1783071479.737006:0:13177:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783071479.782031:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec707c 00000020:00000080:3.0:1783071479.782058:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782c880f000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783071479.782088:0:13177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c7f0f800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783071479.782092:0:13177:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c7f0f800 2 00000020:01000004:3.0:1783071479.782099:0:13177:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9782c7f0f800 from lustre-OST0001 00000020:00000080:3.0:1783071479.782126:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071479.782137:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783071479.782140:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782c7f0b800/lustre-OST0001_UUID 00000020:00000080:3.0:1783071479.782154:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c7f0b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783071479.782162:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1783071479.782165:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c880f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1783071479.782287:0:13177:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 68e3cd25-c67d-4a78-96d1-ad55e0a83e15->MGS 00010000:00010000:3.0:1783071479.782303:0:13177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9783020cec00/0xd360fc6ce6ec6f80 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071479.782314:0:13177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9783020cec00/0xd360fc6ce6ec6f80 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071479.782321:0:13177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783071479.782323:0:13177:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783071479.782326:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783071479.782339:0:13177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:3.0:1783071479.782342:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9783020cec00/0xd360fc6ce6ec6f80 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec6f87 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071479.782358:0:13177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071479.782365:0:13177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071479.782369:0:13177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783071479.782371:0:13177:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783071479.782372:0:13177:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783071479.782380:0:13177:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9782c87c3000 00010000:00010000:3.0:1783071479.782383:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c4ef1400/0xd360fc6ce6ec720b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd360fc6ce6ec7212 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783071479.782410:0:13177:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783071479.782415:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783071479.782423:0:13177:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783071479.782424:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783071479.782429:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783071479.782441:0:13177:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9781c4296a00 x1869685684513664/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783071482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783071479.782466:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783071479.782470:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1783071479.782614:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68e3cd25-c67d-4a78-96d1-ad55e0a83e15:3291:1869685684513664:0@lo:250:kworker.0 10000000:01000000:3.0:1783071479.782996:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783071479.783005:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec6e6f 00000020:00000080:3.0:1783071479.783010:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782c87c3800/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 00000020:01000000:3.0:1783071479.783019:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.116@tcp (flags='') 00000020:00000080:3.0:1783071479.783024:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071479.783028:0:13177:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783071479.783032:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9782c5bbb380) has no exports 00000020:00000080:0.0:1783071479.783112:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c87c3800/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 for MGC192.168.202.116@tcp 10000000:01000000:1.0:1783071479.783285:0:5788:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783071479.783361:0:13177:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.116@tcp: client import never connected 00000100:00080000:3.0:1783071479.783365:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783071479.783367:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783071479.783369:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783071479.783371:0:13177:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783071479.783472:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783071479.783478:0:13177:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.116@tcp (uuid 68e3cd25-c67d-4a78-96d1-ad55e0a83e15) 00000020:00000080:0.0:1783071479.783612:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9782c87c3000 for MGC192.168.202.116@tcp 00000020:00000080:3.0:1783071479.783738:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782c87c7000/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 00000020:00000080:3.0:1783071479.783741:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c87c7000/68e3cd25-c67d-4a78-96d1-ad55e0a83e15 for MGC192.168.202.116@tcp 00000020:01000000:3.0:1783071479.783746:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.116@tcp (68e3cd25-c67d-4a78-96d1-ad55e0a83e15) 00000020:01000000:3.0:1783071479.784014:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783071479.784018:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783071479.784023:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783071479.784028:0:13177:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9781c6ce5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783071479.784033:0:13177:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9782fa3019c0) has exports, disconnecting them 00000020:00080000:3.0:1783071479.784038:0:13177:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9781c6ce5800), last request at 1783071297 00000020:00000080:3.0:1783071479.784042:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec70a6 00000020:00080000:3.0:1783071479.784594:0:13177:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9781c6ce5800): rc 0 00000020:00000080:3.0:1783071479.784600:0:13177:0:(genops.c:906:class_export_put()) final put ffff9781c6ce5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783071479.792179:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c6ce5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783071479.792725:0:13177:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783071479.792731:0:13177:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783071479.792735:0:13177:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783071479.792741:0:13177:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783071479.792873:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1783071479.793005:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9781c6ce4800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1783071479.793718:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1783071479.795712:0:7482:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9782c79e6000:7482] 2 exiting: rc = 0 00000100:00100000:1.0:1783071479.796396:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9782da081400:5774] 1 exiting: rc = 0 00000100:00100000:2.0:1783071479.803052:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9782c650b600:5773] 0 exiting: rc = 1 00000100:00100000:0.0:1783071479.805808:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806177:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9782da080c00:5775] 0 exiting: rc = 1 00000100:00100000:1.0:1783071479.806180:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9782da080400:5776] 1 exiting: rc = 0 00000100:00100000:1.0:1783071479.806282:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9782c797ae00:5777] 2 exiting: rc = 0 00000100:00100000:0.0:1783071479.806382:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806389:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806395:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806412:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806419:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806425:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806431:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806583:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806592:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806597:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806602:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806608:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806613:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806708:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806719:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.806727:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807033:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807039:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807044:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807054:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807059:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807066:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807072:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807078:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807151:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807160:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807165:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807170:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807302:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807319:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807324:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807334:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807340:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807345:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807363:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807369:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807374:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807379:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807384:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807395:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807410:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807416:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807421:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807426:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807441:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807447:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807453:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807459:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807464:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807469:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807474:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807480:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807852:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807859:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807866:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807871:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807876:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807881:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807885:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807900:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807906:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.807910:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.808884:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783071479.808897:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783071479.810911:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071479.810922:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783071479.810928:0:13177:0:(genops.c:906:class_export_put()) final put ffff9781c6ce1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783071479.810933:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c6ce1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783071479.810938:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1783071479.810980:0:13177:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c7f0f800 1 00000020:00000080:1.0:1783071479.810993:0:13177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd360fc6ce6ec704b 00000020:00000080:1.0:1783071479.810999:0:13177:0:(genops.c:906:class_export_put()) final put ffff9781c49e8000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783071479.811015:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783071479.811026:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9781c49e8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783071479.811038:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071479.811043:0:13177:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783071479.811056:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9782fa304d40) has no exports 00000020:00000080:1.0:1783071479.838005:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071479.838022:0:13177:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783071479.838028:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782c7f0b000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783071479.838033:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9782c7f0b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783071479.838040:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783071479.838361:0:13177:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9782c7f09000 00000020:01000000:1.0:1783071479.838635:0:13177:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783071479.838642:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783071479.838647:0:13177:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783071479.838651:0:13177:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9782c6710000) has no exports 00000020:00000080:1.0:1783071479.838701:0:13177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783071479.838709:0:13177:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783071479.838712:0:13177:0:(genops.c:906:class_export_put()) final put ffff9782e39fc000/OSS_uuid 00000020:00000080:1.0:1783071479.838714:0:13177:0:(genops.c:865:class_export_destroy()) destroying export ffff9782e39fc000/OSS_uuid for OSS 00000020:01000000:1.0:1783071479.838718:0:13177:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1783071479.838746:0:5787:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783071479.838927:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9782c88e1800:6587] 1 exiting: rc = 0 00000100:00100000:1.0:1783071479.839726:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9782c5a6b400:6585] 0 exiting: rc = 1 00000100:00100000:2.0:1783071479.840655:0:8704:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9782f9d43400:8704] 3 exiting: rc = 0 00000100:00100000:2.0:1783071479.840761:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9782c66e4a00:6588] 2 exiting: rc = 0 00000100:00100000:1.0:1783071479.840819:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840830:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840839:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840847:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840853:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840864:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840869:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840874:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840899:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840905:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840911:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840916:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840921:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840926:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840932:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840937:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840942:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840947:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840952:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840958:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840963:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840979:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840985:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840989:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840994:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.840999:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841003:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841008:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841013:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841017:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841023:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841028:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841034:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841039:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841053:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841060:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841064:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841069:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841074:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841079:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841089:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841094:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841099:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841109:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841114:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841118:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841123:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841127:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841132:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841137:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841141:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841145:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841150:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841157:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841162:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841167:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841171:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841176:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841191:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841196:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841201:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841205:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841210:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.841215:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842762:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9782c66e5e00:6590] 1 exiting: rc = 0 00000100:00100000:1.0:1783071479.842839:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9782c88e0e00:6589] 0 exiting: rc = 1 00000100:00100000:1.0:1783071479.842899:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842907:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842912:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842916:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842921:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842926:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842931:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842936:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842941:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842947:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842953:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842958:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842975:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842979:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842985:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842989:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842994:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.842999:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843005:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843012:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843018:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843024:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843029:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843034:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843039:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843044:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843049:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843054:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843059:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843064:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843069:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843075:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843080:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843084:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843089:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843093:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843098:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843103:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843108:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843113:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843118:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843124:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843130:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843134:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843139:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843144:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843149:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843161:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843166:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843171:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843176:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843181:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843187:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843192:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843198:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843204:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843209:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843214:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843220:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843225:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843231:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843236:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843241:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.843247:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.844794:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9782c5a6a400:6593] 2 exiting: rc = 0 00000100:00100000:1.0:1783071479.845021:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9782c5a6b800:6592] 1 exiting: rc = 0 00000100:00100000:2.0:1783071479.846288:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9782c5a6aa00:6591] 0 exiting: rc = 1 00000100:00100000:1.0:1783071479.846602:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846610:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846615:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846621:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846625:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846630:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846635:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846641:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846656:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846747:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846755:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846760:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846765:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846771:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846777:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846783:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846801:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846806:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846812:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846818:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846824:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846830:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846836:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846842:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846847:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846853:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846858:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846864:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846870:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846876:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846881:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.846986:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847010:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847016:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847022:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847028:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847033:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847040:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847046:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847052:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847058:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847065:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847070:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847076:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847082:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847088:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847094:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847100:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847106:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847112:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847118:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847131:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847137:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847143:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847149:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847156:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847161:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847179:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847185:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847191:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847196:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847202:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847234:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.847254:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071479.858322:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9782fac3d600:6594] 0 exiting: rc = 1 00000100:00100000:2.0:1783071479.860122:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9782fac3c400:6595] 1 exiting: rc = 0 00000100:00100000:1.0:1783071479.860209:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860219:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860224:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860230:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860235:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860242:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860247:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860253:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860259:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860265:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860269:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860275:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860280:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860285:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860290:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860295:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860300:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860304:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860309:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860315:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860321:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860327:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860348:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860355:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860362:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860369:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860378:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860560:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860569:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860574:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860579:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860584:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860589:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860594:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860599:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860604:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860608:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860613:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860618:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860623:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860628:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860633:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860638:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860653:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860659:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860664:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860669:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860793:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860800:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860805:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860810:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860815:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860821:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860826:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860832:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860837:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860842:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860855:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860860:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860866:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860871:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860877:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860882:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.860906:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783071479.861829:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9782fac3d800:6597] 1 exiting: rc = 0 00000100:00100000:0.0:1783071479.862622:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9782fac3d400:6596] 0 exiting: rc = 1 00000100:00100000:1.0:1783071479.862788:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862798:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862804:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862810:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862816:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862822:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862829:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862848:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862854:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862859:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862864:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862869:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862875:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862881:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862900:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862907:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862913:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862919:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862924:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862945:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862953:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862959:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862965:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862970:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862976:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862981:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862988:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.862994:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863013:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863019:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863025:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863046:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863054:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863059:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863065:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863071:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863078:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863084:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863090:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863096:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863105:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863111:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863117:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863137:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863144:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863149:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863155:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863161:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863167:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863172:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863178:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863185:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863190:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863196:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863202:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863222:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863230:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863235:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863242:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863249:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863255:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863262:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863268:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783071479.863280:0:13177:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783071479.877775:0:13177:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783071494.244122:0:13798:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783071500.199296:0:14210:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783071500.199301:0:14210:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783071500.199423:0:14210:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9781c65c5800 00000020:01000004:3.0:1783071500.199439:0:14210:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783071500.199447:0:14210:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783071500.199461:0:14210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9782f9ec3380) 00000020:00000080:3.0:1783071500.199475:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783071500.218910:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783071500.222488:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1783071500.223312:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1783071500.223449:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1783071500.223942:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783071500.224013:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1783071500.224240:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1783071500.224401:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1783071500.224502:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1783071500.226614:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1783071500.228313:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 274: rc = 0 00100000:10000000:2.0:1783071500.228421:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 274: rc = 0 00100000:10000000:2.0:1783071500.229250:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 597: rc = 0 00100000:10000000:2.0:1783071500.230027:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.230437:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.235415:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 597: rc = 0 00100000:10000000:2.0:1783071500.236619:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.236931:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 597: rc = 0 00100000:10000000:2.0:1783071500.237213:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 597: rc = 0 00100000:10000000:2.0:1783071500.237468:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.237770:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 597: rc = 0 00100000:10000000:2.0:1783071500.238028:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.238299:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 597: rc = 0 00100000:10000000:2.0:1783071500.238544:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 597: rc = 0 00100000:10000000:2.0:1783071500.240599:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 280: rc = 0 00100000:10000000:2.0:1783071500.241062:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 280: rc = 0 00100000:10000000:2.0:1783071500.241449:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 280: rc = 0 00100000:10000000:0.0:1783071500.242422:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 280: rc = 0 00100000:10000000:0.0:1783071500.246629:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 280: rc = 0 00100000:10000000:0.0:1783071500.247267:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 280: rc = 0 00100000:10000000:0.0:1783071500.247525:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 280: rc = 0 00100000:10000000:0.0:1783071500.247860:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 280: rc = 0 00100000:10000000:0.0:1783071500.248353:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 280: rc = 0 00100000:10000000:0.0:1783071500.248612:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 280: rc = 0 00100000:10000000:0.0:1783071500.248910:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 280: rc = 0 00100000:10000000:0.0:1783071500.249292:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 280: rc = 0 00100000:10000000:0.0:1783071500.249539:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 280: rc = 0 00100000:10000000:1.0:1783071500.250027:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 280: rc = 0 00100000:10000000:1.0:1783071500.253621:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 280: rc = 0 00100000:10000000:1.0:1783071500.253954:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 280: rc = 0 00100000:10000000:1.0:1783071500.255750:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 280: rc = 0 00100000:10000000:1.0:1783071500.256030:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 280: rc = 0 00100000:10000000:1.0:1783071500.256615:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 280: rc = 0 00100000:10000000:1.0:1783071500.256919:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 280: rc = 0 00100000:10000000:1.0:1783071500.257206:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 280: rc = 0 00100000:10000000:1.0:1783071500.257470:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 280: rc = 0 00100000:10000000:1.0:1783071500.257721:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 280: rc = 0 00100000:10000000:1.0:1783071500.258359:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 280: rc = 0 00100000:10000000:1.0:1783071500.258606:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 280: rc = 0 00100000:10000000:1.0:1783071500.258880:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 280: rc = 0 00100000:10000000:1.0:1783071500.259428:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 280: rc = 0 00100000:10000000:1.0:1783071500.259664:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 280: rc = 0 00100000:10000000:1.0:1783071500.259964:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 280: rc = 0 00100000:10000000:1.0:1783071500.260586:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 280: rc = 0 00100000:10000000:1.0:1783071500.262520:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 280: rc = 0 00100000:10000000:1.0:1783071500.262849:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 280: rc = 0 00100000:10000000:1.0:1783071500.264659:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 645: rc = 0 00100000:10000000:1.0:1783071500.268701:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1783071500.268892:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 275: rc = 0 00100000:10000000:1.0:1783071500.269088:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1783071500.274920:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 275: rc = 0 00100000:10000000:1.0:1783071500.275220:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1783071500.275302:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 275: rc = 0 00100000:10000000:1.0:1783071500.275714:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1783071500.275797:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 593: rc = 0 00100000:10000000:1.0:1783071500.275986:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1783071500.276055:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 593: rc = 0 00100000:10000000:1.0:1783071500.276257:0:14210:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1783071500.276327:0:14210:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 593: rc = 0 00000020:00000080:1.0:1783071500.276596:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783071500.276604:0:14210:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783071500.276614:0:14210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec8170 00000020:01000004:1.0:1783071500.276623:0:14210:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1783071500.276628:0:14210:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783071500.276633:0:14210:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9781c65c5800 from MGS 00000020:01000004:1.0:1783071500.276637:0:14210:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783071500.276646:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9782c6713380) 00000020:00000080:1.0:1783071500.276656:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1783071500.276746:0:14210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9781c65c5800 from MGS, refs=2 00080000:01000000:1.0:1783071500.276751:0:14210:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783071500.276756:0:14210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec817e 00000100:00100000:1.0:1783071500.276849:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1783071500.276968:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1783071500.276974:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783071500.277905:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783071500.277914:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783071500.278650:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071500.278837:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783071500.278843:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783071500.279642:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783071500.279649:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783071500.279995:0:14210:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783071500.280006:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783071500.282223:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071500.282228:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071500.282231:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071500.282661:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071500.282664:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071500.282666:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071500.287063:0:14210:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783071500.292270:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783071500.304656:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783071500.304757:0:14210:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783071500.304761:0:14210:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783071500.306783:0:14219:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783071500.307030:0:14210:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783071500.307412:0:14210:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783071500.308004:0:14210:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783071500.308499:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071500.308632:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783071500.308637:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783071500.311745:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783071500.311758:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783071500.313651:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783071500.313662:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1783071500.316346:0:14224:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1783071500.316567:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783071500.316586:0:14210:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:2.0:1783071500.316588:0:14210:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783071500.316615:0:14210:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:2.0:1783071500.316628:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (ffff9782fa300000) 00000020:00000080:2.0:1783071500.316642:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783071500.316858:0:14210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9781c6ce0800@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071500.317025:0:14210:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:2.0:1783071500.317031:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783071500.321814:0:14225:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783071500.321903:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 96ce0e42-aa84-4f8d-9a9f-77c6b4147dec) 00000020:00000080:3.0:1783071500.321940:0:14210:0:(genops.c:1406:class_connect()) connect: client 96ce0e42-aa84-4f8d-9a9f-77c6b4147dec, cookie 0xd360fc6ce6ec818c 00000100:00080000:3.0:1783071500.321954:0:14210:0:(import.c:512:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783071500.321962:0:14210:0:(import.c:626:import_select_connection()) MGC192.168.202.116@tcp: import ffff9781c6ce0800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1783071500.321999:0:14210:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c4296300 x1869685684514048/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783071500.322042:0:14210:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 96ce0e42-aa84-4f8d-9a9f-77c6b4147dec->MGS 00000020:01000004:3.0:1783071500.322064:0:14210:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783071500.322074:0:14210:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783071500.322088:0:14210:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9782f9ec19c0) 00000020:00000080:3.0:1783071500.322100:0:14210:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783071500.322271:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3291:1869685684514048:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783071500.322340:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.322401:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514048 00000100:00100000:2.0:1783071500.322407:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514048 00000100:00100000:2.0:1783071500.322437:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.322444:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1869685684514048:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783071500.322466:0:14220:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 96ce0e42-aa84-4f8d-9a9f-77c6b4147dec@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:2.0:1783071500.322500:0:14220:0:(genops.c:1406:class_connect()) connect: client 96ce0e42-aa84-4f8d-9a9f-77c6b4147dec, cookie 0xd360fc6ce6ec819a 00000100:00080000:2.0:1783071500.322631:0:14220:0:(import.c:65:import_set_state_nolock()) ffff9781c6ce4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071500.322704:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+5:3291:x1869685684514048:12345-0@lo:250:mount.lustre.0 Request processed in 258us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.322712:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.322769:0:3291:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783071500.322777:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1783071500.322783:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783071500.322787:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783071500.322790:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c6ce0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783071500.322793:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783071500.322799:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783071500.322804:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3291:1869685684514048:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783071500.337914:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071500.338278:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071500.338284:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783071500.339089:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783071500.339096:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783071500.339445:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783071500.339450:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783071500.340477:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071500.340627:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783071500.340632:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783071500.341311:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783071500.341319:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783071500.381395:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071500.381593:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783071500.381601:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783071500.385243:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783071500.385349:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783071500.387231:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071500.387402:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783071500.387408:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783071500.388403:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783071500.388412:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783071500.389448:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071500.390273:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783071500.390280:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783071500.391615:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783071500.391625:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783071500.392629:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071500.393330:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783071500.393336:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783071500.394407:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783071500.394417:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783071500.425986:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783071500.426249:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783071500.426256:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783071500.432609:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783071500.432626:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783071500.437168:0:14210:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783071500.437182:0:14210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783071500.438374:0:14210:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783071500.438541:0:14210:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783071500.438549:0:14210:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783071500.438739:0:14210:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071500.438776:0:14210:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783071500.438781:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071500.438783:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071500.438784:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071500.438785:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071500.438787:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071500.438788:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071500.438790:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071500.438791:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071500.438793:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071500.438794:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071500.438797:0:14210:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783071500.438799:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071500.438800:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783071500.438801:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071500.438803:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071500.438804:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071500.438805:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071500.438809:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783071500.438810:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783071500.438811:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071500.438812:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071500.438836:0:14210:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783071500.438855:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071500.438923:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071500.438967:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6bff540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.439117:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514176 00000100:00100000:3.0:1783071500.439124:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514176 00000100:00100000:3.0:1783071500.439165:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071500.439175:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+5:14210:x1869685684514176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783071500.439227:0:14223:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783071500.439230:0:14223:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783071500.439233:0:14223:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783071500.439828:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783071500.440195:0:14223:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783071500.442214:0:14245:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783071500.442222:0:14245:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783071500.442225:0:14245:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783071500.442261:0:14245:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783071500.442709:0:14223:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783071500.442722:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783071500.471117:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+5:14210:x1869685684514176:12345-0@lo:253:mount.lustre.0 Request processed in 31930us (32179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.471135:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071500.471298:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783071500.471325:0:14210:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783071500.471329:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071500.471331:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783071500.471333:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071500.471334:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071500.471335:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071500.471337:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071500.471338:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071500.471354:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783071500.471356:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071500.471357:0:14210:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783071500.471378:0:14210:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9781c65c5800 from lustre-MDT0000 10000000:01000000:3.0:1783071500.471524:0:14210:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783071500.471528:0:14210:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783071500.471533:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9782fa300000 10000000:01000000:3.0:1783071500.471540:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071500.471548:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9782fa300000 from 1 10000000:01000000:3.0:1783071500.471551:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783071500.471596:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.471608:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.471618:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071500.471641:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783071500.471717:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.471761:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b7b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.472138:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514304 00000100:00100000:2.0:1783071500.472144:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514304 00000100:00100000:2.0:1783071500.472193:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071500.472201:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+5:14210:x1869685684514304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071500.472227:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071500.472243:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938600/0xd360fc6ce6ec81a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec81a1 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.472266:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938600/0xd360fc6ce6ec81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81a1 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.472286:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938600/0xd360fc6ce6ec81a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81a1 expref: 6 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.472296:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938600, rc 0) 00000100:00100000:2.0:1783071500.472465:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+6:14210:x1869685684514304:12345-0@lo:101:mount.lustre.0 Request processed in 201us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.472472:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071500.472546:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071500.472559:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.472567:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071500.472612:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071500.472638:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.472661:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.472735:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514432 00000100:00100000:2.0:1783071500.472739:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514432 00000100:00100000:2.0:1783071500.472760:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071500.472766:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+6:14210:x1869685684514432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071500.473172:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+6:14210:x1869685684514432:12345-0@lo:501:mount.lustre.0 Request processed in 405us (532us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071500.473179:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071500.473236:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514432:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783071500.473262:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783071500.473277:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.473286:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071500.473303:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9781c65c5800 10000000:01000000:1.0:1783071500.473307:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783071500.473312:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9781c65c5800 10000000:01000000:1.0:1783071500.473376:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783071500.473380:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9781c65c5800 from 1 10000000:01000000:1.0:1783071500.473382:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783071500.473460:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.473468:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.473477:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071500.473489:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071500.473513:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.473572:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.474092:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514560 00000100:00100000:2.0:1783071500.474097:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514560 00000100:00100000:2.0:1783071500.474162:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071500.474169:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+6:14210:x1869685684514560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071500.474179:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071500.474191:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec81b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec81af expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.474210:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec81b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81af expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.474219:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939800/0xd360fc6ce6ec81b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81af expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.474238:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939800, rc 0) 00000100:00100000:2.0:1783071500.474276:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+7:14210:x1869685684514560:12345-0@lo:101:mount.lustre.0 Request processed in 107us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.474282:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783071500.474346:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071500.474357:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81b6 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.474364:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec81b6 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071500.474376:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783071500.474392:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81b6 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.474412:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2600/0xd360fc6ce6ec81af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81b6 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071500.474419:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783071500.474423:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071500.474428:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9781c65c5800 10000000:01000000:1.0:1783071500.474431:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783071500.474434:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783071500.474436:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783071500.474450:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.474457:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.474465:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071500.474477:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071500.474503:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.474781:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.474869:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514688 00000100:00100000:3.0:1783071500.474874:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514688 00000100:00100000:3.0:1783071500.474897:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071500.474903:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+7:14210:x1869685684514688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071500.474911:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071500.474932:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97830217cc00/0xd360fc6ce6ec81c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec81bd expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.474946:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97830217cc00/0xd360fc6ce6ec81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81bd expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.474959:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97830217cc00/0xd360fc6ce6ec81c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec81bd expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.474966:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217cc00, rc 0) 00000100:00100000:3.0:1783071500.475005:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+8:14210:x1869685684514688:12345-0@lo:101:mount.lustre.0 Request processed in 102us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.475011:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783071500.475105:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071500.475115:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81c4 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.475122:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec81c4 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071500.475174:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071500.475199:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.475207:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.475329:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514816 00000100:00100000:3.0:1783071500.475332:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514816 00000100:00100000:3.0:1783071500.475345:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071500.475350:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+8:14210:x1869685684514816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071500.475842:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14210:x1869685684514816:12345-0@lo:501:mount.lustre.0 Request processed in 490us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.475849:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071500.475942:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071500.475970:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071500.476006:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.476040:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.476182:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684514944 00000100:00100000:3.0:1783071500.476187:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684514944 00000100:00100000:3.0:1783071500.476205:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071500.476210:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14210:x1869685684514944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071500.476630:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14210:x1869685684514944:12345-0@lo:503:mount.lustre.0 Request processed in 418us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.476637:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071500.476879:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684514944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071500.477670:0:14246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14246:1869685684515072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071500.477806:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.477877:0:14246:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c502b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.477976:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515072 00000100:00100000:3.0:1783071500.477982:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515072 00000100:00100000:3.0:1783071500.478107:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071500.478115:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14246:x1869685684515072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071500.478394:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14246:x1869685684515072:12345-0@lo:502:llog_process_th.0 Request processed in 279us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.478524:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071500.478594:0:14246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14246:1869685684515072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071500.478618:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071500.478628:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.478631:0:14246:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783071500.478636:0:14246:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783071500.478639:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071500.478655:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9782c6710000) 00000020:00000080:1.0:1783071500.478691:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783071500.478698:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783071500.478776:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783071500.478783:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec81d2 00000020:00000080:1.0:1783071500.479037:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783071500.479042:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071500.479046:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.479052:0:14246:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783071500.479055:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071500.479059:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.479061:0:14246:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783071500.479064:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071500.479072:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9782c6714d40) 00000020:00000080:1.0:1783071500.479082:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783071500.479087:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783071500.479089:0:14246:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783071500.479092:0:14246:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783071500.479099:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783071500.479137:0:14246:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9781c65c5800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783071500.479150:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9782c67119c0) 00000020:00000080:1.0:1783071500.479158:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783071500.479199:0:14246:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783071500.479205:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec81e7 00000020:00000080:1.0:1783071500.479304:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783071500.479310:0:14246:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783071500.479326:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd360fc6ce6ec81ee 00080000:01000000:1.0:1783071500.479332:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783071500.479336:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec81f5 00010000:00010000:2.0:1783071500.581082:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783071500.583334:0:14246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783071500.583702:0:14246:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783071500.584300:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9782fa304d40) 00000020:00000080:2.0:1783071500.584319:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783071500.584499:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783071500.584508:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec8203 00000020:00000080:3.0:1783071500.585115:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783071500.597570:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd360fc6ce6ec820a 00000020:00000080:2.0:1783071500.598100:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783071500.598111:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071500.598118:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071500.598120:0:14246:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783071500.598125:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071500.598130:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071500.598132:0:14246:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783071500.598136:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783071500.598173:0:14246:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783071500.598186:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071500.598189:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071500.598190:0:14246:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783071500.598193:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783071500.598194:0:14246:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783071500.598196:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071500.598197:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071500.598199:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783071500.598201:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071500.598208:0:14246:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783071500.598212:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783071500.598215:0:14246:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783071500.598218:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071500.598219:0:14246:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783071500.598222:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783071500.598227:0:14246:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1783071500.598250:0:14246:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783071500.598253:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783071500.598266:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9782fa3019c0) 00000020:00000080:2.0:1783071500.598278:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783071500.598282:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783071500.598332:0:14246:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783071500.598337:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783071500.598342:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec8218 00010000:00080000:2.0:1783071500.598371:0:14246:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9782d68c6000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1783071500.599234:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1783071500.602207:0:14246:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783071500.602258:0:14246:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783071500.603357:0:14246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071500.605093:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783071500.605218:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783071500.606039:0:14250:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783071500.606046:0:14250:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783071500.606873:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783071500.606887:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783071500.606924:0:14246:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783071500.606945:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec821f 00000100:00080000:0.0:1783071500.606957:0:14246:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071500.606963:0:14246:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9782d68c6000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1783071500.607004:0:14246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782fac8b800 x1869685684515200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783071500.607023:0:14246:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783071500.607080:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783071500.607085:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071500.607087:0:14246:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783071500.607090:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783071500.607093:0:14246:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783071500.607094:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071500.607096:0:14246:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783071500.607098:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783071500.607100:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071500.607101:0:14246:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783071500.607105:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783071500.607110:0:14246:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783071500.607134:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071500.607135:0:14246:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783071500.607140:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783071500.607143:0:14246:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1783071500.607166:0:14246:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783071500.607169:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071500.607189:0:14246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9782d74719c0) 00000020:00000080:0.0:1783071500.607200:0:14246:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783071500.607206:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783071500.607266:0:14246:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783071500.607273:0:14246:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783071500.607278:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd360fc6ce6ec822d 00010000:00080000:0.0:1783071500.607310:0:14246:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9782f9bab800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00000100:00100000:2.0:1783071500.607530:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684515200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783071500.607591:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685684515200 offset 0 length 520: 4 00010000:00010000:0.0:1783071500.607970:0:14246:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783071500.608522:0:14246:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783071500.608545:0:14246:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783071500.612401:0:14246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071500.612477:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783071500.612576:0:14246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1783071500.615890:0:14252:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071500.615898:0:14252:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783071500.617671:0:14246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783071500.617915:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783071500.617960:0:14246:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783071500.617983:0:14246:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec8234 00000100:00080000:1.0:1783071500.617996:0:14246:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071500.618004:0:14246:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9782f9bab800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071500.618110:0:14246:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77cb800 x1869685684515328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071500.618145:0:14246:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1783071500.618239:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684515328:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1783071500.618272:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071500.618278:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.618293:0:14246:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783071500.618297:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071500.618302:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000400:00000100:2.0:1783071500.618311:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685684515328 offset 0 length 520: 4 00000020:00000080:1.0:1783071500.618317:0:14246:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783071500.618322:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783071500.618325:0:14246:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783071500.618329:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071500.618332:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.618333:0:14246:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783071500.618337:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071500.618340:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.618342:0:14246:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783071500.618348:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783071500.618440:0:14246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14246:1869685684515456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071500.618495:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.618519:0:14246:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa26a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.618710:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515456 00000100:00100000:0.0:1783071500.618717:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515456 00000100:00100000:0.0:1783071500.618777:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783071500.618787:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14246:x1869685684515456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071500.619031:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14246:x1869685684515456:12345-0@lo:502:llog_process_th.0 Request processed in 245us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.619039:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071500.620197:0:14246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14246:1869685684515456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783071500.620234:0:14246:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071500.620242:0:14246:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071500.620245:0:14246:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783071500.620250:0:14246:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783071500.620518:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783071500.620538:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783071500.620563:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81c4 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.620576:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb3e00/0xd360fc6ce6ec81bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81c4 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071500.620598:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9781c65c5800 from 1 10000000:01000000:2.0:1783071500.620601:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071500.620634:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.620643:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.620654:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071500.620700:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071500.620770:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.620816:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071500.620881:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515584 00000100:00100000:1.0:1783071500.620888:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515584 00000100:00100000:1.0:1783071500.620934:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071500.620942:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+9:14210:x1869685684515584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071500.620955:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071500.620972:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec823b expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.620995:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.621016:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.621025:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071500.621060:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+10:14210:x1869685684515584:12345-0@lo:101:mount.lustre.0 Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.621066:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783071500.621149:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071500.621162:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.621171:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071500.621845:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515712:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783071500.621893:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.621916:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.621938:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515712 00000100:00100000:2.0:1783071500.621942:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515712 00000100:00100000:2.0:1783071500.621972:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071500.621985:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+10:14210:x1869685684515712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783071500.622003:0:14222:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783071500.622008:0:14222:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783071500.622081:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+10:14210:x1869685684515712:12345-0@lo:256:mount.lustre.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.622089:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783071500.622306:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515712:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783071500.624664:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783071500.625054:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.625068:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071500.625077:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9781c65c5800 from 1 10000000:01000000:2.0:1783071500.625080:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071500.625121:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.625141:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.625152:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071500.625177:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071500.625246:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.625286:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071500.626740:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515840 00000100:00100000:1.0:1783071500.626752:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515840 00000100:00100000:1.0:1783071500.626812:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071500.626824:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+10:14210:x1869685684515840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071500.626841:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1783071500.626853:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071500.626859:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783071500.626861:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8249 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783071500.626862:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071500.626870:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783071500.626894:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.626904:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071500.626912:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3400, rc 0) 00000100:00100000:1.0:1783071500.626980:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14210:x1869685684515840:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.626988:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071500.627039:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684515968:0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.627072:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071500.627143:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684515968 00000100:00100000:1.0:1783071500.627148:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684515968 00000100:00100000:1.0:1783071500.627170:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071500.627177:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:3293:x1869685684515968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071500.627211:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:3293:x1869685684515968:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.627218:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071500.627254:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684515968:0@lo:400:kworker.0 00000100:00100000:3.0:1783071500.627602:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684515840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071500.627618:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.627627:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071500.627737:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071500.627765:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.627788:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2945d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.627927:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516096 00000100:00100000:2.0:1783071500.627932:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516096 00000100:00100000:2.0:1783071500.627969:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783071500.627977:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14210:x1869685684516096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071500.628395:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14210:x1869685684516096:12345-0@lo:501:mount.lustre.0 Request processed in 417us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.628431:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071500.628470:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071500.628517:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.628591:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2945d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.628631:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516224 00000100:00100000:0.0:1783071500.628636:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516224 00000100:00100000:0.0:1783071500.628665:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783071500.628698:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071500.628867:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516224:12345-0@lo:503:mount.lustre.0 Request processed in 195us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.628875:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783071500.628901:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071500.629209:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783071500.630561:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14254:1869685684516352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071500.630618:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.630716:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c2945f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.634573:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516352 00000100:00100000:0.0:1783071500.634589:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516352 00000100:00100000:0.0:1783071500.634706:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783071500.634720:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14254:x1869685684516352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783071500.635068:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14254:x1869685684516352:12345-0@lo:502:llog_process_th.0 Request processed in 350us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.635077:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783071500.635190:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14254:1869685684516352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071500.635227:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071500.635237:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.635239:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071500.635247:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9781c65c5800 00000020:00000080:3.0:1783071500.635249:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071500.635257:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071500.635259:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.635260:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783071500.635262:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071500.635264:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.635266:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071500.635269:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9781c65c5800 00000020:00000080:3.0:1783071500.635271:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071500.635331:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071500.635334:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.635336:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783071500.635338:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071500.635340:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.635341:0:14254:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071500.635345:0:14254:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9781c65c5800 00000020:00000080:3.0:1783071500.635347:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783071500.635395:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14254:1869685684516480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071500.635454:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.647117:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.647488:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516480 00000100:00100000:2.0:1783071500.647499:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516480 00000100:00100000:2.0:1783071500.647554:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783071500.647564:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14254:x1869685684516480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071500.647866:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14254:x1869685684516480:12345-0@lo:502:llog_process_th.0 Request processed in 302us (12411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.647874:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783071500.650294:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14254:1869685684516480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783071500.650337:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071500.650346:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071500.650348:0:14254:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783071500.650353:0:14254:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783071500.651245:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783071500.651270:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071500.651298:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.651312:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071500.651360:0:14210:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783071500.651363:0:14210:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9781c65c5800 10000000:01000000:3.0:1783071500.651366:0:14210:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9781c65c5800 10000000:01000000:3.0:1783071500.651370:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783071500.651376:0:14210:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9781c65c5800 from 1 10000000:01000000:3.0:1783071500.651379:0:14210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783071500.651485:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.651495:0:14210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.651504:0:14210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071500.651541:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783071500.651605:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.651642:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.651714:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516608 00000100:00100000:0.0:1783071500.651730:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516608 00000100:00100000:0.0:1783071500.651809:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783071500.651818:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14210:x1869685684516608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071500.651834:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071500.651849:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8200/0xd360fc6ce6ec825e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8257 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071500.651876:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8200/0xd360fc6ce6ec825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8257 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071500.651887:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b8200/0xd360fc6ce6ec825e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8257 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071500.651896:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8200, rc 0) 00000100:00100000:0.0:1783071500.651942:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516608:12345-0@lo:101:mount.lustre.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.651956:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783071500.652069:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783071500.652083:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec825e expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.652092:0:14210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec825e expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071500.652216:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071500.652243:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.652261:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.652329:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516736 00000100:00100000:0.0:1783071500.652333:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516736 00000100:00100000:0.0:1783071500.652352:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783071500.652359:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071500.653839:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516736:12345-0@lo:501:mount.lustre.0 Request processed in 1475us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.653848:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783071500.655559:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071500.655621:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071500.655709:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.655760:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071500.655825:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516864 00000100:00100000:0.0:1783071500.655831:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516864 00000100:00100000:0.0:1783071500.655872:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783071500.655879:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071500.656063:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684516864:12345-0@lo:503:mount.lustre.0 Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071500.656070:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783071500.656493:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684516864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783071500.659756:0:14257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14257:1869685684516992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071500.659842:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.659886:0:14257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783071500.660084:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684516992 00000100:00100000:1.0:1783071500.660093:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684516992 00000100:00100000:1.0:1783071500.661215:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783071500.661231:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14257:x1869685684516992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783071500.661525:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14257:x1869685684516992:12345-0@lo:502:llog_process_th.0 Request processed in 298us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071500.661534:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783071500.661733:0:14257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14257:1869685684516992:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783071500.661802:0:14257:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783071500.661817:0:14257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9782fa303380) 00000020:00000080:2.0:1783071500.661839:0:14257:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1783071500.662019:0:14257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9781c65c5800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783071500.662024:0:14257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9781c65c5800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783071500.662026:0:14257:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9781c65c5800 4 00010000:00080000:2.0:1783071500.662053:0:14257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9782f9ea7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1783071500.671781:0:14257:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1783071500.671899:0:14257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783071500.671941:0:14257:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783071500.671958:0:14257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd360fc6ce6ec826c 00000100:00080000:2.0:1783071500.671969:0:14257:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783071500.671984:0:14257:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9782f9ea7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1783071500.672022:0:14257:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c51c4a80 x1869685684517120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071500.672110:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684517120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783071500.672199:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783071500.672330:0:14257:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783071500.672467:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071500.672472:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071500.672481:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071500.672484:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783071500.674282:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517120 00000100:00100000:2.0:1783071500.674295:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517120 00000100:00100000:2.0:1783071500.674341:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.674349:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1869685684517120:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783071500.683734:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1869685684517120:12345-0@lo:38:llog_process_th.0 Request processed in 9362us (11513us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783071500.683750:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.684419:0:14257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14257:1869685684517248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783071500.684491:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.684525:0:14257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c4948540 going to sleep for 11 seconds 00000100:00100000:3.0:1783071500.688285:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517248 00000100:00100000:3.0:1783071500.688300:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517248 00000100:00100000:3.0:1783071500.688368:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783071500.688379:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14257:x1869685684517248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783071500.690757:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14257:x1869685684517248:12345-0@lo:502:llog_process_th.0 Request processed in 2373us (6258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071500.690770:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783071500.691760:0:14257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14257:1869685684517248:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783071500.691797:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1783071500.692414:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071500.692422:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9ea7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071500.692428:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783071500.692431:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684517120:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1783071500.692815:0:14210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783071500.692841:0:14210:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783071500.692856:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec825e expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.692868:0:14210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217ce00/0xd360fc6ce6ec8257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec825e expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783071500.692918:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783071500.692920:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783071500.692921:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071500.692923:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071500.692924:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071500.692925:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071500.692927:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071500.692928:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783071500.692930:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071500.692931:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071500.692936:0:14210:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783071500.692938:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783071500.692939:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783071500.692940:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071500.692946:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071500.692947:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071500.692947:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071500.692948:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071500.692949:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783071500.692950:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071500.692951:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783071500.692974:0:14210:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783071500.692991:0:14210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684517376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783071500.693053:0:14210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.693102:0:14210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071500.693828:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517376 00000100:00100000:1.0:1783071500.693836:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517376 00000100:00100000:1.0:1783071500.695250:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783071500.695265:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14210:x1869685684517376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783071500.695298:0:14223:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071500.695312:0:14223:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783071500.765663:0:14223:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783071500.765701:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783071500.765795:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783071500.765801:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783071500.765822:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.765841:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.765851:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.765893:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071500.765908:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 12 pid: 14223 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071500.765936:0:14244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684517504:0@lo:104: 00000100:00100000:3.0:1783071500.766002:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071500.766057:0:14244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6b4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071500.766162:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517504 00000100:00100000:2.0:1783071500.766170:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517504 00000100:00100000:2.0:1783071500.766221:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.766231:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684517504:12345-0@lo:104: 00010000:00010000:2.0:1783071500.766253:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766308:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071500.766314:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684517504:12345-0@lo:104: Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.766334:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783071500.766356:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071500.766362:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766369:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939400 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071500.766373:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766382:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071500.766389:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071500.766394:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783071500.766432:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766439:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071500.766460:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766467:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939400/0xd360fc6ce6ec823b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8242 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.766482:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071500.766484:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071500.766485:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071500.766509:0:14244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4296300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684517504:0@lo:104: 00010000:00010000:2.0:1783071500.766534:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071500.766960:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071500.766972:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3295:1869685684517632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071500.767006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071500.767827:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517632 00000100:00100000:2.0:1783071500.767834:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517632 00010000:00010000:2.0:1783071500.767861:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 13 pid: 14223 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071500.767886:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071500.767893:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+13:3295:x1869685684517632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071500.767906:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071500.767923:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 13 pid: 14223 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.767935:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 13 pid: 14223 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.767951:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec823b expref: 13 pid: 14223 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.767965:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.767973:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783071500.767987:0:14213:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002186810s 00010000:00010000:2.0:1783071500.767992:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.767999:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768011:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768018:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768023:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071500.768027:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768034:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768048:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768057:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071500.768101:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3295:x1869685684517632:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.768108:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783071500.768139:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768146:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071500.768152:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec8273 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071500.768791:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3295:1869685684517632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071500.777393:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14210:x1869685684517376:12345-0@lo:253:mount.lustre.0 Request processed in 82123us (84329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071500.777429:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783071500.777576:0:14210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14210:1869685684517376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783071500.777593:0:14210:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783071500.777602:0:14210:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071500.777604:0:14210:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783071500.777606:0:14210:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071500.777607:0:14210:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071500.777608:0:14210:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071500.777609:0:14210:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071500.777611:0:14210:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783071500.777613:0:14210:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783071500.777615:0:14210:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071500.777616:0:14210:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783071500.777633:0:14210:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783071500.785982:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.786301:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071500.786668:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.787007:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071500.787507:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.787670:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071500.789006:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.789338:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071500.789710:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.790024:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783071500.790501:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783071500.790661:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1783071500.816362:0:14210:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783071500.816828:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783071500.817184:0:14266:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783071500.817189:0:14266:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1783071500.817327:0:14267:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1783071500.817398:0:14267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071500.820306:0:14267:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783071500.820391:0:14267:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783071500.820396:0:14267:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1783071500.824335:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783071500.824465:0:14210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783071500.825192:0:14210:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783071500.825202:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783071500.825433:0:14210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783071500.827477:0:14210:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783071500.828094:0:14210:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783071500.828188:0:14210:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1783071500.829877:0:14210:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1783071500.838433:0:14210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783071500.863597:0:14210:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783071500.863635:0:14210:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6bc01cab988 00100000:10000000:0.0:1783071500.863643:0:14210:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783071500.864416:0:14210:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783071500.864431:0:14210:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783071500.864450:0:14210:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783071500.864468:0:14210:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783071501.345507:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071501.545044:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071501.545052:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9781c65c5800 from 6 10000000:01000000:0.0:1783071501.545057:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071501.545111:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071501.545122:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071501.545133:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071501.545166:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684517760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071501.545236:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071501.545302:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782ca0bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071501.545589:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517760 00000100:00100000:1.0:1783071501.545597:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517760 00000100:00100000:1.0:1783071501.545649:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071501.545667:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14225:x1869685684517760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071501.545697:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071501.545711:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec827a expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071501.545745:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071501.545753:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071501.545762:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071501.545801:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684517760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071501.545808:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783071501.545852:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684517760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071501.545864:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071501.545872:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071501.545928:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684517888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783071501.545958:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071501.545970:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9cdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1783071501.546283:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684517888 00000100:00100000:2.0:1783071501.546288:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684517888 00000100:00100000:2.0:1783071501.546321:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783071501.546328:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684517888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783071501.546341:0:14223:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783071501.546357:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783071501.546360:0:14223:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783071501.546433:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684517888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071501.546441:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783071501.547596:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684517888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783071501.547645:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783071501.547657:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071501.547666:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071501.729975:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071502.368978:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071502.759165:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783071503.393135:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071504.342986:0:14509:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783071504.417470:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071505.441937:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071506.144931:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071506.144937:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071506.144940:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071506.144942:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071506.144943:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783071506.144945:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783071506.144948:0:38:0:(import.c:65:import_set_state_nolock()) ffff9782f9ea7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783071506.144958:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9782f9ea7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1783071506.144976:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782fac8ad80 x1869685684518144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783071506.144999:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071506.145012:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684518016:0@lo:400:kworker.0 00000100:00100000:0.0:1783071506.145074:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071506.145122:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684518144:0@lo:38:kworker.0 00000100:00100000:0.0:1783071506.145148:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071506.145285:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518016 00000100:00100000:2.0:1783071506.145291:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518016 00000100:00100000:2.0:1783071506.145327:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071506.145333:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3294:x1869685684518016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071506.145376:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3294:x1869685684518016:12345-0@lo:400:kworker.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071506.145380:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783071506.145416:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518144 00000100:00100000:2.0:1783071506.145420:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518144 00000100:00100000:2.0:1783071506.145437:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071506.145442:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1869685684518144:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783071506.145471:0:14230:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:2.0:1783071506.145506:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd360fc6ce6ec8288 00000004:00100000:2.0:1783071506.145522:0:14230:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071506.145634:0:14230:0:(import.c:65:import_set_state_nolock()) ffff9782c306d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071506.145666:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869685684518144:12345-0@lo:38:kworker.0 Request processed in 224us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071506.145705:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783071506.145747:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9782fac8ad80 x1869685684518144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783071506.145759:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783071506.145765:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783071506.145768:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071506.145770:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9ea7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071506.145774:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869685684518144:0@lo:38:kworker.0 00000100:00100000:2.0:1783071506.145795:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684518016:0@lo:400:kworker.0 00010000:00010000:3.0:1783071506.464815:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783071506.724593:0:14660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd66581360 20000000:00000080:0.0:1783071506.724611:0:14660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9782c2e6bc00 uarg=0000000000000000 20000000:01000000:0.0:1783071506.724644:0:14660:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783071506.724655:0:14660:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783071506.724660:0:14660:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783071506.726141:0:14661:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1783071506.726447:0:14660:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783071506.732512:0:14660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783071506.732545:0:14660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.732565:0:14660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.732574:0:14660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.732617:0:14660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.732631:0:14660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 11 pid: 14222 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071506.732645:0:14660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14660:1869685684518272:0@lo:104: 00000100:00100000:0.0:1783071506.732750:0:14660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071506.732792:0:14660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31ac480 going to sleep for 11 seconds 00000100:00100000:1.0:1783071506.732854:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518272 00000100:00100000:1.0:1783071506.732861:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518272 00000100:00100000:1.0:1783071506.732920:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071506.732929:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14660:x1869685684518272:12345-0@lo:104: 00010000:00010000:1.0:1783071506.732940:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.732986:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783071506.732991:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14660:x1869685684518272:12345-0@lo:104: Request processed in 64us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071506.732998:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783071506.733017:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071506.733022:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733029:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:1.0:1783071506.733033:0:14216:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733042:0:14216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783071506.733078:0:14216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071506.733083:0:14216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783071506.733109:0:14216:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733115:0:14216:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783071506.733132:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733140:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c7939000/0xd360fc6ce6ec8249 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8250 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733156:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071506.733158:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071506.733159:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071506.733175:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684518400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071506.733199:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071506.733327:0:14660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14660:1869685684518272:0@lo:104: 00010000:00010000:0.0:1783071506.733343:0:14660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071506.733401:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518400 00000100:00100000:1.0:1783071506.733406:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518400 00010000:00010000:1.0:1783071506.733422:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 12 pid: 14222 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071506.733475:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071506.733481:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3292:x1869685684518400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783071506.733491:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071506.733495:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 12 pid: 14222 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733511:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 12 pid: 14222 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733523:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c9fb3400/0xd360fc6ce6ec8250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec8249 expref: 12 pid: 14222 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733535:0:14215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733543:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733553:0:14215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733560:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733567:0:14215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733574:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733580:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071506.733584:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733590:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733611:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071506.733619:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783071506.733643:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:3292:x1869685684518400:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071506.733650:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783071506.734589:0:14660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.734600:0:14660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071506.734618:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b9e00/0xd360fc6ce6ec828f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071506.734989:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684518400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071507.489562:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783071508.256803:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071508.256811:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9781c65c5800 from 10 10000000:01000000:1.0:1783071508.256817:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071508.256876:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.256888:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071508.256898:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071508.256923:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071508.257109:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071508.257154:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cc04e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071508.257462:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518528 00000100:00100000:3.0:1783071508.257471:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518528 00000100:00100000:3.0:1783071508.257528:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783071508.257659:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+11:14225:x1869685684518528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071508.257711:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071508.257729:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8296 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.257868:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.257880:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.257890:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c000, rc 0) 00000100:00100000:3.0:1783071508.257990:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684518528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.257997:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783071508.258523:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071508.258605:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.258615:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071508.258759:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071508.259221:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071508.259456:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c88c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071508.262504:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518656 00000100:00100000:1.0:1783071508.262517:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518656 00000100:00100000:1.0:1783071508.262587:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783071508.262596:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684518656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071508.263093:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684518656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 496us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071508.263109:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783071508.263449:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071508.263499:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071508.263547:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071508.263580:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fd39a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783071508.263595:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518784 00000100:00100000:3.0:1783071508.263600:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518784 00000100:00100000:3.0:1783071508.263634:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071508.263641:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684518784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783071508.263871:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14225:x1869685684518784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071508.263878:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783071508.264190:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684518784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783071508.268353:0:14728:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783071508.268431:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783071508.268454:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783071508.268481:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071508.268492:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071508.518868:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071509.539413:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071510.240811:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071500/real 1783071500] req@ffff9781c77cb800 x1869685684515328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071510.240977:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c77cb800 x1869685684515328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071510.240990:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071500/real 1783071500] req@ffff9782fac8b800 x1869685684515200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071510.241002:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9782fac8b800 x1869685684515200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071510.241019:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9bab800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071510.241089:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071510.241093:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684515328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783071510.241099:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782d68c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783071510.242176:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071510.242182:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783071510.242186:0:8:0:(import.c:65:import_set_state_nolock()) ffff9782d68c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071510.242191:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1783071510.242197:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783071510.242204:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9782d68c6000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071510.242224:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77ca680 x1869685684519040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071510.242234:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071510.242237:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783071510.242238:0:8:0:(import.c:65:import_set_state_nolock()) ffff9782f9bab800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071510.242241:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1783071510.242243:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783071510.242246:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9782f9bab800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071510.242255:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77c8000 x1869685684519168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071510.242307:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684519296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.242375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.242813:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684518912:0@lo:400:kworker.0 00000100:00100000:2.0:1783071510.242859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.242906:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519296 00000100:00100000:2.0:1783071510.242913:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519296 00000100:00100000:2.0:1783071510.242957:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071510.242966:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684519296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071510.243020:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684519296:12345-0@lo:400:kworker.0 Request processed in 54us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.243026:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783071510.243067:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9781c77ca300 x1869685684519296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071510.243078:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684519296:0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.243276:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684518912 00000100:00100000:1.0:1783071510.243280:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684518912 00000100:00100000:1.0:1783071510.243317:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783071510.243323:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3293:x1869685684518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071510.243407:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:3293:x1869685684518912:12345-0@lo:400:kworker.0 Request processed in 84us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.243429:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783071510.243585:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071510.243591:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684515200:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783071510.243853:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684519040:0@lo:8:kworker.0 00000400:00000100:1.0:1783071510.243884:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685684519040 offset 0 length 520: 4 00000100:00100000:1.0:1783071510.243906:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684519168:0@lo:8:kworker.0 00000400:00000100:1.0:1783071510.243924:0:3291:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869685684519168 offset 0 length 520: 4 00000100:00100000:3.0:1783071510.244096:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684518912:0@lo:400:kworker.0 00000020:01000004:2.0:1783071510.493792:0:14861:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783071510.493797:0:14861:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783071510.493931:0:14861:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9782c3016000 00000020:01000004:2.0:1783071510.493946:0:14861:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783071510.493957:0:14861:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783071510.493971:0:14861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9782c5bbb380) 00000020:00000080:2.0:1783071510.493985:0:14861:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783071510.516773:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783071510.517199:0:14861:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783071510.518039:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783071510.518328:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783071510.518618:0:14861:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783071510.519401:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 497: rc = 0 00100000:10000000:3.0:1783071510.519495:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 497: rc = 0 00100000:10000000:3.0:1783071510.519671:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:3.0:1783071510.521549:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 602: rc = 0 00100000:10000000:3.0:1783071510.523138:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 602: rc = 0 00100000:10000000:3.0:1783071510.523427:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 602: rc = 0 00100000:10000000:3.0:1783071510.523967:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 602: rc = 0 00100000:10000000:3.0:1783071510.524224:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 602: rc = 0 00100000:10000000:3.0:1783071510.524463:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 602: rc = 0 00000020:00000080:3.0:1783071510.525413:0:14861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783071510.525424:0:14861:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783071510.525435:0:14861:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd360fc6ce6ec82ab 00000020:01000004:3.0:1783071510.525443:0:14861:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783071510.525463:0:14861:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783071510.525473:0:14861:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783071510.525479:0:14861:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783071510.525483:0:14861:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783071510.525495:0:14861:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9782f9ec0000) 00000020:00000080:3.0:1783071510.526270:0:14861:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1783071510.528823:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783071510.529193:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783071510.529200:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783071510.536226:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071510.536243:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783071510.538225:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783071510.538236:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783071510.543385:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071510.543563:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071510.543571:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783071510.545856:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071510.545868:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1783071510.562807:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071510.574076:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071510.574634:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783071510.574641:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783071510.575958:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783071510.575968:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783071510.577096:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783071510.577102:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783071510.579711:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783071510.579888:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783071510.579894:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783071510.580564:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783071510.580570:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783071510.621625:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783071510.622163:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783071510.622170:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1783071510.624303:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1783071510.624316:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783071510.625161:0:14861:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783071510.625188:0:14861:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783071510.625194:0:14861:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783071510.634512:0:14861:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783071510.634561:0:14861:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783071510.634566:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783071510.634567:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071510.634569:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071510.634570:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071510.634571:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071510.634573:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071510.634574:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071510.634576:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071510.634578:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071510.634581:0:14861:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783071510.634584:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071510.634585:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071510.634586:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071510.634587:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071510.634589:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071510.634590:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071510.634591:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071510.634592:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071510.634593:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783071510.634621:0:14861:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783071510.634656:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783071510.635026:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.635159:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.635243:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519424 00000100:00100000:0.0:1783071510.635251:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519424 00000100:00100000:0.0:1783071510.635577:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071510.635588:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14861:x1869685684519424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783071510.635628:0:14223:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783071510.635631:0:14223:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783071510.635635:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783071510.644096:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14861:x1869685684519424:12345-0@lo:253:mount.lustre.0 Request processed in 8500us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.644112:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783071510.644142:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071510.644161:0:14861:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783071510.644165:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071510.644166:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783071510.644167:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071510.644169:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071510.644170:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071510.644171:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071510.644172:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071510.644174:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071510.644176:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783071510.644195:0:14861:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9782c3016000 from lustre-OST0000 10000000:01000000:0.0:1783071510.644224:0:14861:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783071510.644226:0:14861:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783071510.644234:0:14861:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9782fa300000 local copy 00010000:00010000:0.0:1783071510.644245:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.645164:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.645211:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.645253:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.645279:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519552 00000100:00100000:2.0:1783071510.645288:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519552 00000100:00100000:2.0:1783071510.645335:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783071510.645344:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14861:x1869685684519552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071510.645523:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14861:x1869685684519552:12345-0@lo:501:mount.lustre.0 Request processed in 178us (310us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071510.645531:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783071510.646079:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519552:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783071510.646094:0:14861:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783071510.646261:0:14861:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783071510.646270:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.646290:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071510.646313:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9782c3016000 10000000:01000000:0.0:1783071510.647177:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783071510.647186:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9782fa300000 10000000:01000000:0.0:1783071510.647189:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783071510.647192:0:14861:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9782fa300000 from 1 10000000:01000000:0.0:1783071510.647196:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783071510.647229:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.647237:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.647248:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.647265:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071510.647315:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.648210:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519680 00000100:00100000:0.0:1783071510.648219:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.648220:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519680 00000100:00100000:2.0:1783071510.648280:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783071510.648289:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+12:14861:x1869685684519680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071510.648303:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.648319:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec82c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec82b9 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.648343:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec82c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82b9 expref: 13 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.648354:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939200/0xd360fc6ce6ec82c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82b9 expref: 13 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.648362:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939200, rc 0) 00000100:00100000:2.0:1783071510.648424:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+13:14861:x1869685684519680:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.648445:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783071510.648522:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071510.648538:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82c0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.648548:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec82c0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071510.648575:0:14861:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783071510.648637:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82c0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.648655:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8c00/0xd360fc6ce6ec82b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82c0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071510.648662:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783071510.648666:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783071510.648695:0:14861:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783071510.648698:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783071510.648717:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.648725:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.648733:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.648750:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071510.648777:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.648808:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.648823:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519808 00000100:00100000:1.0:1783071510.648829:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519808 00000100:00100000:1.0:1783071510.648870:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783071510.648878:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+13:14861:x1869685684519808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071510.648885:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071510.648894:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb3c00/0xd360fc6ce6ec82ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec82c7 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.648908:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb3c00/0xd360fc6ce6ec82ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82c7 expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.648916:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb3c00/0xd360fc6ce6ec82ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82c7 expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.648922:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3c00, rc 0) 00000100:00100000:1.0:1783071510.649010:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684519808:12345-0@lo:101:mount.lustre.0 Request processed in 133us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.649024:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783071510.649193:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071510.649204:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ce expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.649212:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec82ce expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071510.650532:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783071510.652569:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071510.653147:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783071510.653195:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783071510.653230:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783071510.653352:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783071510.653391:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783071510.653500:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783071510.653567:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783071510.653575:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783071510.653991:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.654060:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.654141:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.654180:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684519936 00000100:00100000:1.0:1783071510.654188:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684519936 00000100:00100000:1.0:1783071510.654299:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783071510.654310:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684519936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071510.654758:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684519936:12345-0@lo:501:mount.lustre.0 Request processed in 449us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.654766:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783071510.654862:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684519936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.654895:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071510.654925:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.655566:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071510.655597:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520064 00000100:00100000:3.0:1783071510.655603:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520064 00000100:00100000:2.0:1783071510.655963:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783071510.655974:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071510.656356:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520064:12345-0@lo:503:mount.lustre.0 Request processed in 384us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.656363:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783071510.656540:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783071510.657503:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071510.657585:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071510.657808:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.658132:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.658197:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520192 00000100:00100000:2.0:1783071510.658204:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520192 00000100:00100000:2.0:1783071510.658243:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783071510.658261:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071510.658856:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520192:12345-0@lo:502:mount.lustre.0 Request processed in 603us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.658863:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783071510.659016:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783071510.659351:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783071510.659464:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783071510.659500:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783071510.659548:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783071510.659577:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783071510.659594:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783071510.659905:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783071510.659950:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783071510.660001:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1783071510.660051:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1783071510.660087:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1783071510.660135:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1783071510.660176:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071510.660323:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.660359:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071510.660756:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520320 00000100:00100000:3.0:1783071510.660764:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520320 00000100:00100000:3.0:1783071510.660809:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783071510.660817:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783071510.661146:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520320:12345-0@lo:502:mount.lustre.0 Request processed in 330us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.661152:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783071510.661369:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783071510.661456:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1783071510.661464:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1783071510.662961:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783071510.662972:0:14875:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783071510.662980:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.662982:0:14875:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783071510.662991:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783071510.663010:0:14875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9782c5d48000) 00000020:00000080:1.0:1783071510.663040:0:14875:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783071510.663048:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783071510.663132:0:14875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c3016000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783071510.663141:0:14875:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783071510.663150:0:14875:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd360fc6ce6ec82dc 00010000:00010000:1.0:1783071510.668325:0:14875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1783071510.669228:0:14875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783071510.675576:0:14875:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783071510.677315:0:14875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783071510.677327:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071510.677334:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677336:0:14875:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783071510.677340:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783071510.677342:0:14875:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1783071510.677344:0:14875:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071510.677345:0:14875:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783071510.677346:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783071510.677348:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677350:0:14875:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783071510.677352:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071510.677355:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677363:0:14875:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071510.677367:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071510.677369:0:14875:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071510.677371:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071510.677373:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677375:0:14875:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071510.677378:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071510.677380:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677381:0:14875:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783071510.677384:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783071510.677452:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071510.677455:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071510.677456:0:14875:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783071510.677458:0:14875:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783071510.678971:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783071510.679008:0:14861:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783071510.679030:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ce expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.679042:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8800/0xd360fc6ce6ec82c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ce expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071510.679050:0:14861:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c3016000 from 1 10000000:01000000:0.0:1783071510.679053:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071510.679089:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.679098:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.679116:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.679142:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071510.679210:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.679265:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.679513:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520448 00000100:00100000:2.0:1783071510.679522:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520448 00000100:00100000:2.0:1783071510.679563:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783071510.679571:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+14:14861:x1869685684520448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071510.679585:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071510.679595:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec82e3 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.679622:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 15 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.679630:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 15 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.679637:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071510.679707:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520448:12345-0@lo:101:mount.lustre.0 Request processed in 135us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.679784:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071510.679800:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.679809:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071510.679983:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000040:00080000:0.0:1783071510.680892:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783071510.681566:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071510.681880:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783071510.681924:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783071510.681996:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783071510.682001:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783071510.683398:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.683474:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.683523:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.683584:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520576 00000100:00100000:1.0:1783071510.683592:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520576 00000100:00100000:0.0:1783071510.683868:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071510.683881:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.684406:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520576:12345-0@lo:501:mount.lustre.0 Request processed in 526us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.684424:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783071510.684478:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071510.684515:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071510.684555:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.684586:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.684590:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520704 00000100:00100000:2.0:1783071510.684595:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520704 00000100:00100000:2.0:1783071510.685191:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783071510.685200:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071510.685368:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520704:12345-0@lo:503:mount.lustre.0 Request processed in 168us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.685375:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783071510.685399:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071510.686202:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071510.686276:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071510.686325:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.686365:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3d7e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.686413:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520832 00000100:00100000:0.0:1783071510.686419:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520832 00000100:00100000:0.0:1783071510.686458:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783071510.686465:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071510.686655:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520832:12345-0@lo:502:mount.lustre.0 Request processed in 190us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.686662:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783071510.686949:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071510.687347:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783071510.687397:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783071510.687448:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783071510.687501:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783071510.687536:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783071510.687587:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783071510.687624:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783071510.687669:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783071510.688145:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071510.688207:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.688226:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3d7e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.689663:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684520960 00000100:00100000:2.0:1783071510.689911:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684520960 00000100:00100000:2.0:1783071510.690038:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783071510.690049:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071510.690328:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684520960:12345-0@lo:502:mount.lustre.0 Request processed in 280us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.690336:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783071510.690438:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684520960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071510.690583:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783071510.690597:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1783071510.691948:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071510.691961:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.691963:0:14879:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783071510.691970:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c3016000 00000020:00000080:1.0:1783071510.691972:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783071510.691979:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071510.691981:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.691982:0:14879:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783071510.691985:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071510.691987:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.691988:0:14879:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783071510.691991:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c3016000 00000020:00000080:1.0:1783071510.691993:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783071510.692206:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071510.692210:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.692211:0:14879:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783071510.692213:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783071510.692221:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.692222:0:14879:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783071510.692226:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9782c3016000 00000020:00000080:1.0:1783071510.692227:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783071510.692262:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783071510.692265:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783071510.692266:0:14879:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783071510.692269:0:14879:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783071510.692309:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783071510.692549:0:14861:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071510.692567:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.692578:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071510.692615:0:14861:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783071510.692618:0:14861:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9782c3016000 10000000:01000000:1.0:1783071510.692620:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9782c3016000 10000000:01000000:1.0:1783071510.692624:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071510.692629:0:14861:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c3016000 from 1 10000000:01000000:1.0:1783071510.692632:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783071510.692816:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.692825:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.692837:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071510.692862:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071510.693004:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.694275:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.696856:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521088 00000100:00100000:0.0:1783071510.696871:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521088 00000100:00100000:0.0:1783071510.696923:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783071510.696932:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684521088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071510.696962:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071510.696983:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b9200/0xd360fc6ce6ec82f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec82f1 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.697013:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b9200/0xd360fc6ce6ec82f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82f1 expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.697025:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b9200/0xd360fc6ce6ec82f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82f1 expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.697061:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9200, rc 0) 00000100:00100000:0.0:1783071510.697142:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521088:12345-0@lo:101:mount.lustre.0 Request processed in 211us (4138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.697149:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783071510.698170:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071510.698197:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82f8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.698209:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec82f8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071510.700532:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1783071510.703143:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071510.703828:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783071510.703878:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783071510.703912:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783071510.705205:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783071510.705788:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783071510.705845:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783071510.705882:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783071510.705930:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783071510.706741:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783071510.706785:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783071510.706820:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783071510.706870:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783071510.706907:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783071510.708661:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783071510.708790:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783071510.708829:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783071510.708862:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783071510.708910:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783071510.708960:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783071510.708994:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783071510.709079:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783071510.709116:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783071510.709146:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783071510.709535:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783071510.709580:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783071510.709610:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783071510.709984:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783071510.710019:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783071510.710571:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783071510.710581:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1783071510.710735:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071510.710811:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.712178:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521216 00000100:00100000:0.0:1783071510.712194:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521216 00000100:00100000:1.0:1783071510.712219:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.712267:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783071510.712279:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071510.712724:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521216:12345-0@lo:501:mount.lustre.0 Request processed in 446us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.712732:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783071510.712931:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071510.713175:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071510.713281:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.713358:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521344 00000100:00100000:0.0:1783071510.713364:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521344 00000100:00100000:0.0:1783071510.713461:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783071510.713469:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071510.713523:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.713890:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521344:12345-0@lo:503:mount.lustre.0 Request processed in 421us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.713898:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783071510.714877:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783071510.717911:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783071510.717990:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071510.718072:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.718109:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.719686:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521472 00000100:00100000:1.0:1783071510.719699:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521472 00000100:00100000:1.0:1783071510.719755:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783071510.719764:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071510.720183:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521472:12345-0@lo:502:mount.lustre.0 Request processed in 421us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071510.720195:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783071510.720479:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071510.720793:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783071510.720836:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783071510.720868:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783071510.720910:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783071510.720931:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783071510.723734:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783071510.723791:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783071510.723835:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783071510.723884:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783071510.723913:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783071510.723930:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783071510.726503:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783071510.726560:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783071510.726581:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783071510.726607:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783071510.726637:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783071510.726705:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783071510.726757:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783071510.726794:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783071510.726823:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783071510.726860:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783071510.726896:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783071510.726919:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783071510.726977:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783071510.726997:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783071510.727013:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783071510.729131:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783071510.729212:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783071510.730151:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783071510.730203:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783071510.731453:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783071510.731514:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783071510.731549:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783071510.731596:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783071510.731619:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783071510.733242:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783071510.733320:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783071510.733454:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783071510.733487:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783071510.733541:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783071510.733589:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071510.733700:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.733748:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783071510.734270:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521600 00000100:00100000:0.0:1783071510.734279:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521600 00000100:00100000:0.0:1783071510.734338:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783071510.734346:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071510.734556:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521600:12345-0@lo:502:mount.lustre.0 Request processed in 211us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.734563:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783071510.736336:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783071510.736452:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783071510.736466:0:14861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783071510.738624:0:14884:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783071510.738652:0:14884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9782c5d499c0) 00000020:00000080:1.0:1783071510.739233:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1783071510.739512:0:14884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c3016000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783071510.739516:0:14884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c3016000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783071510.739519:0:14884:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c3016000 3 00010000:00080000:1.0:1783071510.739564:0:14884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9782c664d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1783071510.743888:0:14884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1783071510.744015:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783071510.744408:0:14884:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783071510.744424:0:14884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd360fc6ce6ec8306 00000100:00080000:1.0:1783071510.744434:0:14884:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783071510.744449:0:14884:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9782c664d000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071510.744479:0:14884:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77c9180 x1869685684521728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071510.744510:0:14884:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783071510.744610:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071510.744616:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783071510.744619:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783071510.744622:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783071510.744807:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783071510.744821:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684521856:0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.744898:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071510.744958:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521856 00000100:00100000:3.0:1783071510.744963:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521856 00000100:00100000:3.0:1783071510.744997:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783071510.745003:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684521856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071510.745184:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684521856:12345-0@lo:400:kworker.0 Request processed in 180us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071510.745190:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783071510.745287:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9781c4297480 x1869685684521856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071510.745302:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684521856:0@lo:400:kworker.0 00000100:00100000:2.0:1783071510.745571:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684521728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783071510.745597:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071510.745635:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521728 00000100:00100000:2.0:1783071510.745639:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521728 00000100:00100000:2.0:1783071510.745708:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071510.745713:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1869685684521728:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783071510.745738:0:14230:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:2.0:1783071510.745781:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd360fc6ce6ec830d 00000004:00100000:2.0:1783071510.745798:0:14230:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783071510.745827:0:14230:0:(import.c:65:import_set_state_nolock()) ffff9781c4994800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071510.745870:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869685684521728:12345-0@lo:38:llog_process_th.0 Request processed in 156us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.745876:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783071510.745904:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9781c77c9180 x1869685684521728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071510.745910:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071510.745915:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783071510.745920:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783071510.745923:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071510.745925:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782c664d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071510.745928:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1869685684521728:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783071510.746489:0:14884:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1783071510.746759:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783071510.746786:0:14861:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783071510.746804:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82f8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.746813:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2200/0xd360fc6ce6ec82f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec82f8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783071510.746854:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783071510.746856:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071510.746857:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071510.746858:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071510.746859:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071510.746861:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071510.746867:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071510.746869:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071510.746870:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071510.746874:0:14861:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783071510.746876:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783071510.746877:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783071510.746878:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783071510.746879:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783071510.746880:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783071510.746881:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783071510.746882:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783071510.746883:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783071510.746884:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783071510.746909:0:14861:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783071510.746921:0:14861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783071510.747012:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071510.747143:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684521984 00000100:00100000:1.0:1783071510.747147:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684521984 00000100:00100000:2.0:1783071510.747201:0:14861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071510.750759:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783071510.750778:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14861:x1869685684521984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783071510.750810:0:14223:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783071510.750822:0:14223:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783071510.777541:0:14223:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783071510.777581:0:14223:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783071510.778510:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783071510.778519:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783071510.778616:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.778635:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.778654:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.778740:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.778754:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 16 pid: 14220 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.778770:0:14244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684522112:0@lo:104: 00000100:00100000:0.0:1783071510.778835:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.779000:0:14244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071510.779864:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522112 00000100:00100000:2.0:1783071510.779875:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522112 00000100:00100000:2.0:1783071510.780020:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071510.780030:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684522112:12345-0@lo:104: 00010000:00010000:2.0:1783071510.780334:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071510.780415:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071510.780421:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684522112:12345-0@lo:104: Request processed in 393us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.780428:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071510.780438:0:14244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684522112:0@lo:104: 00010000:00010000:3.0:1783071510.780480:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071510.780487:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.780504:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071510.780509:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.780517:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071510.780539:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071510.780585:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071510.780591:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071510.780654:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.780661:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783071510.780726:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684522240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783071510.780757:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071510.780814:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522240 00000100:00100000:0.0:1783071510.780819:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522240 00010000:00010000:3.0:1783071510.780830:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780839:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 17 pid: 14220 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.780855:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b8000/0xd360fc6ce6ec827a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8281 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071510.780860:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071510.780865:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:3292:x1869685684522240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071510.780873:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071510.780875:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071510.780875:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071510.780877:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071510.780880:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 17 pid: 14220 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780890:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 17 pid: 14220 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780903:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c9fb3000/0xd360fc6ce6ec8281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec827a expref: 17 pid: 14220 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780917:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780936:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783071510.780950:0:14214:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002431923s 00010000:00010000:0.0:1783071510.780954:0:14214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780961:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780968:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780975:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780980:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071510.780984:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.780990:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.781314:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071510.781323:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.781412:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.781421:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782fa7b8400/0xd360fc6ce6ec8314 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071510.781435:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071510.781602:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3292:x1869685684522240:12345-0@lo:103:ldlm_bl.0 Request processed in 735us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071510.781610:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071510.781993:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684522240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071510.784592:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14861:x1869685684521984:12345-0@lo:253:mount.lustre.0 Request processed in 33814us (37571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071510.784603:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783071510.784797:0:14861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14861:1869685684521984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783071510.784812:0:14861:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783071510.784816:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783071510.784817:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783071510.784819:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783071510.784820:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783071510.784821:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783071510.784823:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783071510.784824:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783071510.784827:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783071510.784828:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783071510.784845:0:14861:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783071510.789839:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071510.789975:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071510.790143:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071510.790315:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783071510.790497:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783071510.790711:0:14861:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783071510.791959:0:14861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783071510.826751:0:14861:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783071510.826761:0:14861:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783071510.826792:0:14861:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783071510.826870:0:14861:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783071510.826888:0:14861:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783071510.826916:0:14861:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783071511.585700:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071512.609857:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071512.611115:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783071512.611122:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9781c65c5800 from 7 10000000:01000000:0.0:1783071512.611125:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783071512.611169:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.611182:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071512.611194:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071512.611218:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684522368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071512.611285:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071512.611337:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5b94780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071512.612399:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522368 00000100:00100000:1.0:1783071512.612410:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522368 00000100:00100000:1.0:1783071512.612472:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783071512.612482:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+15:14225:x1869685684522368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071512.612496:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071512.612513:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec831b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.612540:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.612564:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 16 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071512.612574:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3800, rc 0) 00000100:00100000:1.0:1783071512.612646:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14225:x1869685684522368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071512.612653:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783071512.612943:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684522368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071512.612964:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.612974:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071512.613034:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684522496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783071512.613072:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071512.613093:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783071512.613108:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522496 00000100:00100000:3.0:1783071512.613111:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522496 00000100:00100000:3.0:1783071512.613137:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071512.613144:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14225:x1869685684522496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783071512.613157:0:14223:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071512.613173:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071512.613176:0:14223:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783071512.613249:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14225:x1869685684522496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071512.613257:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783071512.613287:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684522496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783071512.613407:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071512.613414:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071512.613432:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071512.994587:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783071513.633411:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071514.661620:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071515.681125:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071515.882456:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071515.882463:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071515.882465:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071515.882469:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071515.882515:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071515.882534:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684522624:0@lo:400:kworker.0 00000100:00100000:0.0:1783071515.882613:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071515.882693:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684522880:0@lo:400:kworker.0 00000100:00100000:0.0:1783071515.882725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071515.882743:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071515.882748:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684522752:0@lo:400:kworker.0 00000100:00100000:0.0:1783071515.882768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071515.882811:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522880 00000100:00100000:0.0:1783071515.882980:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522880 00000100:00080000:1.0:1783071515.883072:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071515.883120:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522752 00000100:00100000:0.0:1783071515.883123:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522752 00000100:00100000:0.0:1783071515.883135:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071515.883140:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684522880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071515.883180:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684522880:12345-0@lo:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071515.883185:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783071515.883196:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783071515.883200:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684522752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071515.883220:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684522752:12345-0@lo:400:kworker.0 Request processed in 19us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071515.883225:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783071515.883256:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782fac89180 x1869685684522752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071515.883270:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684522752:0@lo:400:kworker.0 00010000:00080000:0.0:1783071515.883278:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782fac8aa00 x1869685684522880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071515.883344:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684522880:0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.883533:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684522624 00000100:00100000:3.0:1783071515.883537:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684522624 00000100:00100000:3.0:1783071515.883573:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783071515.883581:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3292:x1869685684522624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071515.883635:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3292:x1869685684522624:12345-0@lo:400:kworker.0 Request processed in 55us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071515.883642:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783071515.883818:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684522624:0@lo:400:kworker.0 00010000:00010000:3.0:1783071516.706082:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071516.901192:0:15228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783071517.733664:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071518.753429:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071519.776885:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071520.800831:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783071520.994135:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071520.994143:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783071520.994146:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783071520.994149:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783071520.994215:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684523008:0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994303:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071520.994349:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783071520.994356:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684523136:0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994385:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071520.994407:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071520.994415:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684523264:0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071520.994466:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523008 00000100:00100000:0.0:1783071520.994473:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523008 00000100:00100000:0.0:1783071520.994514:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783071520.994522:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3292:x1869685684523008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994587:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3292:x1869685684523008:12345-0@lo:400:kworker.0 Request processed in 64us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071520.994595:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783071520.994625:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523136 00000100:00100000:0.0:1783071520.994628:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523136 00000100:00100000:0.0:1783071520.994657:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523264 00000100:00100000:0.0:1783071520.994660:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523264 00000100:00100000:0.0:1783071520.994710:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071520.994717:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684523136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994751:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684523136:12345-0@lo:400:kworker.0 Request processed in 35us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071520.994757:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783071520.994770:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783071520.994776:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684523264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994806:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1869685684523264:12345-0@lo:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071520.994812:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783071520.994829:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783071520.994853:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782fac89180 x1869685684523264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071520.994867:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1869685684523264:0@lo:400:kworker.0 00010000:00080000:0.0:1783071520.994895:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782fac8aa00 x1869685684523136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071520.994905:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684523136:0@lo:400:kworker.0 00000100:00100000:0.0:1783071520.994913:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684523008:0@lo:400:kworker.0 00010000:00010000:2.0:1783071521.824924:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783071522.011598:0:15530:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783071522.011602:0:15530:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783071522.011771:0:15530:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9782c7f0b800 00000020:01000004:1.0:1783071522.011788:0:15530:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783071522.011802:0:15530:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783071522.011816:0:15530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9782c5d4b380) 00000020:00000080:1.0:1783071522.011832:0:15530:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783071522.029423:0:15530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783071522.029658:0:15530:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783071522.030641:0:15530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783071522.031017:0:15530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783071522.031288:0:15530:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783071522.031610:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 633: rc = 0 00100000:10000000:1.0:1783071522.031955:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 633: rc = 0 00100000:10000000:1.0:1783071522.032146:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 633: rc = 0 00100000:10000000:1.0:1783071522.032620:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 298: rc = 0 00100000:10000000:1.0:1783071522.033049:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 298: rc = 0 00100000:10000000:1.0:1783071522.033381:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 298: rc = 0 00100000:10000000:1.0:1783071522.033954:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 298: rc = 0 00100000:10000000:1.0:1783071522.034287:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 298: rc = 0 00100000:10000000:1.0:1783071522.034533:0:15530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 298: rc = 0 00000020:00000080:1.0:1783071522.035336:0:15530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783071522.035349:0:15530:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783071522.035359:0:15530:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd360fc6ce6ec8330 00000020:01000004:1.0:1783071522.035367:0:15530:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783071522.035388:0:15530:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783071522.035392:0:15530:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783071522.035398:0:15530:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783071522.035419:0:15530:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783071522.035423:0:15530:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783071522.045495:0:15530:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783071522.045545:0:15530:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1783071522.045550:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783071522.045561:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.045563:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.045564:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.045570:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.045571:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.045573:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.045574:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.045576:0:15530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071522.045579:0:15530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1783071522.045581:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071522.045582:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.045583:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.045584:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.045585:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.045585:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.045586:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.045587:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.045588:0:15530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783071522.045613:0:15530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783071522.045631:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071522.045727:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.045971:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783071522.046055:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523392 00000100:00100000:1.0:1783071522.046062:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523392 00000100:00100000:1.0:1783071522.046142:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783071522.046152:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:15530:x1869685684523392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783071522.046182:0:14222:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783071522.046185:0:14222:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783071522.046189:0:14222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783071522.052393:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:15530:x1869685684523392:12345-0@lo:253:mount.lustre.0 Request processed in 6233us (6657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071522.052408:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783071522.052497:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071522.052512:0:15530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783071522.052516:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071522.052517:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.052519:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.052520:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.052521:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.052523:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.052524:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.052526:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.052528:0:15530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783071522.052547:0:15530:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9782c7f0b800 from lustre-OST0001 10000000:01000000:0.0:1783071522.052585:0:15530:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783071522.052588:0:15530:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783071522.052597:0:15530:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9782fa300000 local copy 00010000:00010000:0.0:1783071522.052608:0:15530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071522.053141:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071522.053176:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.053312:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071522.053355:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523520 00000100:00100000:3.0:1783071522.053361:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523520 00000100:00100000:3.0:1783071522.053436:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783071522.053445:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:15530:x1869685684523520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783071522.053597:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:15530:x1869685684523520:12345-0@lo:501:mount.lustre.0 Request processed in 153us (420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783071522.053604:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783071522.053663:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783071522.053700:0:15530:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783071522.053879:0:15530:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783071522.053886:0:15530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.053903:0:15530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff97830217d000/0xd360fc6ce6ec81a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec81a8 expref: -99 pid: 14210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071522.053924:0:15530:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9782c7f0b800 10000000:01000000:1.0:1783071522.053929:0:15530:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783071522.053933:0:15530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783071522.053936:0:15530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783071522.053940:0:15530:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783071522.053943:0:15530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783071522.053965:0:15530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.053973:0:15530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.053982:0:15530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071522.053997:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783071522.054026:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071522.054443:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5a00540 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.054614:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523648 00000100:00100000:0.0:1783071522.054619:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523648 00000100:00100000:0.0:1783071522.054642:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783071522.054648:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:15530:x1869685684523648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071522.054658:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071522.054670:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec833e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8337 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.054895:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec833e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8337 expref: 17 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.054909:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b8600/0xd360fc6ce6ec833e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8337 expref: 17 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.054918:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8600, rc 0) 00000100:00100000:0.0:1783071522.054961:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684523648:12345-0@lo:101:mount.lustre.0 Request processed in 313us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.054968:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783071522.055089:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071522.055103:0:15530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec833e expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.055112:0:15530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec833e expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783071522.056500:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783071522.058142:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783071522.058438:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783071522.058485:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783071522.058521:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783071522.058584:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783071522.058633:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783071522.058665:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783071522.058967:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783071522.058977:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783071522.059061:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071522.059125:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.059166:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cadf6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071522.059360:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523776 00000100:00100000:1.0:1783071522.059367:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523776 00000100:00100000:1.0:1783071522.059418:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783071522.059428:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684523776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071522.059968:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684523776:12345-0@lo:501:mount.lustre.0 Request processed in 540us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071522.059977:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783071522.060168:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071522.060221:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783071522.060265:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.060296:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cadf6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.060345:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684523904 00000100:00100000:2.0:1783071522.060350:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684523904 00000100:00100000:2.0:1783071522.060376:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783071522.060383:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684523904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071522.060743:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684523904:12345-0@lo:503:mount.lustre.0 Request processed in 358us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.060757:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783071522.061253:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684523904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783071522.062082:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783071522.062150:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.062637:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.062704:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782edf02180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.062941:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524032 00000100:00100000:2.0:1783071522.062948:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524032 00000100:00100000:2.0:1783071522.063000:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783071522.063009:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684524032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071522.063265:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684524032:12345-0@lo:502:mount.lustre.0 Request processed in 256us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.063273:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783071522.063475:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783071522.064152:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783071522.064253:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783071522.064292:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783071522.064357:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783071522.064396:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783071522.064432:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783071522.064470:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783071522.064488:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783071522.064522:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1783071522.064828:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.064938:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.065025:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782edf02180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071522.065165:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524160 00000100:00100000:1.0:1783071522.065170:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524160 00000100:00100000:1.0:1783071522.065308:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783071522.065318:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684524160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783071522.065491:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684524160:12345-0@lo:502:mount.lustre.0 Request processed in 175us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071522.065496:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783071522.065564:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783071522.065619:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1783071522.065626:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1783071522.066939:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783071522.066949:0:15531:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783071522.066955:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783071522.066958:0:15531:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783071522.066963:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783071522.066979:0:15531:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9782d7470000) 00000020:00000080:0.0:1783071522.066999:0:15531:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783071522.067005:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783071522.067057:0:15531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c7f0b800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783071522.067062:0:15531:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783071522.067067:0:15531:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd360fc6ce6ec834c 00010000:00010000:1.0:1783071522.074148:0:15531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783071522.074547:0:15531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1783071522.076643:0:15531:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783071522.078533:0:15531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783071522.078545:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071522.078585:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071522.078588:0:15531:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783071522.078592:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071522.078598:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071522.078599:0:15531:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783071522.078602:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783071522.078604:0:15531:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783071522.078606:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071522.078617:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071522.078618:0:15531:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783071522.078621:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783071522.078625:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071522.078626:0:15531:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783071522.078629:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783071522.078724:0:15531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783071522.078729:0:15531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783071522.078730:0:15531:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783071522.078734:0:15531:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1783071522.079045:0:15530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783071522.079069:0:15530:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783071522.079095:0:15530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec833e expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.079107:0:15530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2400/0xd360fc6ce6ec8337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec833e expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071522.079115:0:15530:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0b800 from 1 10000000:01000000:0.0:1783071522.079118:0:15530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071522.079152:0:15530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.079160:0:15530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.079179:0:15530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071522.079203:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783071522.079272:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.079316:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782edf02a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.079423:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524288 00000100:00100000:2.0:1783071522.079432:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524288 00000100:00100000:2.0:1783071522.079482:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783071522.079492:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:15530:x1869685684524288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071522.079506:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071522.079519:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8353 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.079541:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.079563:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.079572:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938000, rc 0) 00000100:00100000:2.0:1783071522.079770:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524288:12345-0@lo:101:mount.lustre.0 Request processed in 278us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.079777:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783071522.083965:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783071522.083993:0:15530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.084004:0:15530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071522.084445:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783071522.085385:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071522.086081:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783071522.086131:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783071522.086213:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783071522.086221:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783071522.086297:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071522.086574:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071522.086649:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.088618:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524416 00000100:00100000:0.0:1783071522.088629:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524416 00000100:00100000:0.0:1783071522.088704:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783071522.088714:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071522.088995:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524416:12345-0@lo:501:mount.lustre.0 Request processed in 282us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.089002:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783071522.089027:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783071522.089072:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783071522.089117:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071522.089186:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.089216:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524544 00000100:00100000:2.0:1783071522.089221:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524544 00000100:00100000:2.0:1783071522.089253:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783071522.089267:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071522.089447:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524544:12345-0@lo:503:mount.lustre.0 Request processed in 181us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.089454:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783071522.089522:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071522.090217:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071522.090282:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071522.090326:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.090359:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c85ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.090400:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524672 00000100:00100000:0.0:1783071522.090404:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524672 00000100:00100000:0.0:1783071522.090434:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783071522.090442:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.090588:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524672:12345-0@lo:502:mount.lustre.0 Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.090594:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783071522.090664:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071522.091183:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783071522.091232:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783071522.091281:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783071522.091318:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783071522.091352:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783071522.091402:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783071522.091437:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783071522.091470:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783071522.091498:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071522.091541:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.091624:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fd39aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.091996:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524800 00000100:00100000:0.0:1783071522.092002:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524800 00000100:00100000:0.0:1783071522.092076:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783071522.092085:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.092255:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524800:12345-0@lo:502:mount.lustre.0 Request processed in 171us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.092269:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783071522.092337:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783071522.092427:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783071522.092438:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783071522.093654:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071522.093700:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.093703:0:15535:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783071522.093723:0:15535:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c7f0b800 00000020:00000080:3.0:1783071522.093726:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071522.093733:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071522.093736:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.093737:0:15535:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783071522.093740:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071522.093940:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.093942:0:15535:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783071522.093948:0:15535:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9782c7f0b800 00000020:00000080:3.0:1783071522.093951:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071522.094008:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071522.094011:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.094013:0:15535:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783071522.094015:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783071522.094018:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.094019:0:15535:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783071522.094023:0:15535:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9782c7f0b800 00000020:00000080:3.0:1783071522.094025:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783071522.094060:0:15535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783071522.094063:0:15535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783071522.094064:0:15535:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783071522.094068:0:15535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783071522.095871:0:15530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783071522.095914:0:15530:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071522.095938:0:15530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.095950:0:15530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071522.096011:0:15530:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783071522.096014:0:15530:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9782c7f0b800 10000000:01000000:2.0:1783071522.096018:0:15530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9782c7f0b800 10000000:01000000:2.0:1783071522.096022:0:15530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783071522.096027:0:15530:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9782c7f0b800 from 1 10000000:01000000:2.0:1783071522.096030:0:15530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783071522.096063:0:15530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.096071:0:15530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.096082:0:15530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071522.096102:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783071522.096162:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.096206:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.103093:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684524928 00000100:00100000:0.0:1783071522.103107:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684524928 00000100:00100000:0.0:1783071522.103183:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783071522.103195:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684524928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783071522.103212:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071522.103229:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782fa7b8a00/0xd360fc6ce6ec8368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec8361 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.103256:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782fa7b8a00/0xd360fc6ce6ec8368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8361 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.103268:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782fa7b8a00/0xd360fc6ce6ec8368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8361 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.103277:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b8a00, rc 0) 00000100:00100000:0.0:1783071522.103349:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684524928:12345-0@lo:101:mount.lustre.0 Request processed in 157us (7186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.103356:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783071522.105041:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684524928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783071522.105069:0:15530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8368 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.105082:0:15530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8368 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783071522.106136:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1783071522.106479:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783071522.109052:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783071522.109141:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783071522.109178:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783071522.109227:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783071522.109266:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783071522.109345:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783071522.109392:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783071522.109429:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783071522.109482:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783071522.109519:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783071522.109569:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783071522.109619:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783071522.109657:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783071522.109734:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783071522.112042:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783071522.112098:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783071522.112137:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783071522.112189:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783071522.112226:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783071522.112260:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783071522.112309:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783071522.112359:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783071522.112393:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783071522.112448:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783071522.112485:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783071522.112520:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783071522.124323:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783071522.124418:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783071522.124454:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783071522.124502:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1783071522.124538:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1783071522.124591:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1783071522.124627:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1783071522.125919:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1783071522.125991:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1783071522.126042:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1783071522.126070:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1783071522.126168:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1783071522.126176:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1783071522.126272:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071522.126340:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.126376:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.126472:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525056 00000100:00100000:0.0:1783071522.126479:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525056 00000100:00100000:0.0:1783071522.126518:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783071522.126528:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783071522.127963:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525056:12345-0@lo:501:mount.lustre.0 Request processed in 1431us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.127974:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783071522.128231:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783071522.128273:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071522.128317:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.128346:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525184 00000100:00100000:2.0:1783071522.128352:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525184 00000100:00100000:2.0:1783071522.128381:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783071522.128389:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783071522.128522:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525184:12345-0@lo:503:mount.lustre.0 Request processed in 133us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.128529:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783071522.128575:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c840 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.128586:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783071522.131219:0:15530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783071522.131306:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071522.131395:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.131430:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c7c6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.131517:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525312 00000100:00100000:0.0:1783071522.131531:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525312 00000100:00100000:0.0:1783071522.131587:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783071522.131597:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.131944:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525312:12345-0@lo:502:mount.lustre.0 Request processed in 239us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.131951:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783071522.133172:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071522.133458:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783071522.133519:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783071522.134146:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783071522.134216:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783071522.134254:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783071522.134317:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783071522.134356:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783071522.134392:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783071522.134438:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783071522.134474:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783071522.134511:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783071522.134569:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783071522.134612:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783071522.134639:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783071522.134721:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783071522.134763:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783071522.134791:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783071522.134829:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783071522.134868:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783071522.134894:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783071522.134931:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783071522.134964:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783071522.134997:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783071522.135039:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783071522.135067:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783071522.135092:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783071522.135128:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783071522.135154:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783071522.135197:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783071522.135243:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783071522.135277:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783071522.135310:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783071522.135343:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783071522.135391:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783071522.135438:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783071522.135485:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783071522.135520:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783071522.135569:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783071522.135627:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783071522.135658:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783071522.135724:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783071522.135800:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071522.135840:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782edf02180 going to sleep for 11 seconds 00000100:00100000:0.0:1783071522.136178:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525440 00000100:00100000:0.0:1783071522.136186:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525440 00000100:00100000:0.0:1783071522.136237:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783071522.136246:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783071522.136457:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525440:12345-0@lo:502:mount.lustre.0 Request processed in 211us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071522.136465:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783071522.137146:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783071522.137248:0:15530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1783071522.137261:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783071522.142108:0:15540:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783071522.142125:0:15540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9782d7473380) 00000020:00000080:0.0:1783071522.142162:0:15540:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1783071522.142505:0:15540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9782c7f0b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783071522.142510:0:15540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9782c7f0b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783071522.142513:0:15540:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9782c7f0b800 3 00010000:00080000:0.0:1783071522.142539:0:15540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9781c4324800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1783071522.144278:0:15540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1783071522.144371:0:15540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783071522.144406:0:15540:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783071522.144418:0:15540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd360fc6ce6ec8376 00000100:00080000:0.0:1783071522.144429:0:15540:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783071522.144434:0:15540:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9781c4324800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1783071522.144469:0:15540:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9782fac89180 x1869685684525568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783071522.144575:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684525568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783071522.144644:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071522.144789:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525568 00000100:00100000:1.0:1783071522.144797:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525568 00000100:00100000:1.0:1783071522.144828:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071522.144846:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1869685684525568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783071522.144869:0:14230:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1783071522.144898:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd360fc6ce6ec837d 00000004:00100000:1.0:1783071522.144912:0:14230:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783071522.144940:0:14230:0:(import.c:65:import_set_state_nolock()) ffff9782c880f800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783071522.145130:0:15540:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783071522.145205:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869685684525568:12345-0@lo:38:llog_process_th.0 Request processed in 358us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071522.145213:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783071522.145238:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071522.145242:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783071522.145252:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071522.145254:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783071522.145379:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684525824:0@lo:400:kworker.0 00000100:00100000:1.0:1783071522.145409:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.145469:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684525696:0@lo:400:kworker.0 00000100:00100000:0.0:1783071522.145495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783071522.145658:0:15540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1783071522.145877:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525824 00000100:00100000:3.0:1783071522.145882:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525824 00000100:00080000:0.0:1783071522.145931:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071522.145978:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525696 00000100:00100000:1.0:1783071522.145982:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525696 00000100:00100000:3.0:1783071522.145998:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071522.146007:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071522.146013:0:14230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783071522.146019:0:14230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783071522.146051:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684525824:12345-0@lo:400:kworker.0 Request processed in 46us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071522.146058:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783071522.146072:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783071522.146085:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684525696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783071522.146116:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684525696:12345-0@lo:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071522.146122:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783071522.146338:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9781c77c8a80 x1869685684525824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783071522.146354:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684525824:0@lo:400:kworker.0 00010000:00080000:0.0:1783071522.146952:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9781c77c9f80 x1869685684525696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071522.146963:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684525696:0@lo:400:kworker.0 00000020:01000000:0.0:1783071522.147731:0:15530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783071522.147771:0:15530:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783071522.147791:0:15530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8368 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071522.147802:0:15530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939a00/0xd360fc6ce6ec8361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8368 expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783071522.147953:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783071522.147956:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.147957:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.147959:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.147960:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.147962:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.147963:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.147965:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.147967:0:15530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071522.147970:0:15530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783071522.147972:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783071522.147974:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.147975:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.147976:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.147982:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.147983:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.147984:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.147985:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.147986:0:15530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783071522.148005:0:15530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783071522.148021:0:15530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783071522.148081:0:15530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071522.148117:0:15530:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa7bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071522.148951:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684525952 00000100:00100000:3.0:1783071522.148959:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684525952 00000100:00100000:3.0:1783071522.149032:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783071522.149041:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782ca790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:15530:x1869685684525952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783071522.149069:0:14222:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783071522.149082:0:14222:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783071522.149625:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9782fac89180 x1869685684525568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783071532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783071522.149637:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783071522.149646:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783071522.149653:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783071522.149658:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783071522.149670:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9781c4324800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783071522.149703:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1869685684525568:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783071522.168804:0:14222:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783071522.168820:0:14222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783071522.168839:0:14244:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783071522.168845:0:14244:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783071522.168866:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.168884:0:14244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.168893:0:14244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.168944:0:14244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071522.168959:0:14244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 19 pid: 14222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071522.168975:0:14244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684526080:0@lo:104: 00000100:00100000:1.0:1783071522.169566:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071522.169609:0:14244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071522.169658:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526080 00000100:00100000:2.0:1783071522.169666:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526080 00000100:00100000:2.0:1783071522.169723:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071522.169748:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684526080:12345-0@lo:104: 00010000:00010000:2.0:1783071522.169762:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071522.169822:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783071522.169829:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:14244:x1869685684526080:12345-0@lo:104: Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071522.169837:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071522.169846:0:14244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14244:1869685684526080:0@lo:104: 00010000:00010000:1.0:1783071522.169875:0:14244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170089:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071522.170095:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170101:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:3.0:1783071522.170104:0:14217:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170110:0:14217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783071522.170115:0:14217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783071522.170118:0:14217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783071522.170375:0:14217:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170382:0:14217:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783071522.170409:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170417:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9000/0xd360fc6ce6ec831b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec8322 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071522.170424:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684526208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071522.170432:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071522.170434:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071522.170436:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071522.170453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071522.170494:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526208 00000100:00100000:3.0:1783071522.170499:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526208 00010000:00010000:3.0:1783071522.170519:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 20 pid: 14222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071522.170543:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783071522.170563:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+20:3293:x1869685684526208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783071522.170576:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071522.170581:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 20 pid: 14222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170591:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 20 pid: 14222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170612:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c9fb3800/0xd360fc6ce6ec8322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec831b expref: 20 pid: 14222 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170625:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170638:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783071522.170652:0:14214:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002431923s 00010000:00010000:3.0:1783071522.170655:0:14214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170660:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170664:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170667:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170701:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071522.170928:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170939:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170959:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071522.170971:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071522.171003:0:14244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071522.171012:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3293:x1869685684526208:12345-0@lo:103:ldlm_bl.0 Request processed in 462us (557us total) trans 0 rc 0/0 00010000:00010000:1.0:1783071522.171012:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071522.171020:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783071522.171020:0:14244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec8384 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071522.171050:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684526208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783071522.174024:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782ca790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:15530:x1869685684525952:12345-0@lo:253:mount.lustre.0 Request processed in 24978us (25937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071522.174037:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783071522.174107:0:15530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:15530:1869685684525952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783071522.174121:0:15530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783071522.174124:0:15530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783071522.174125:0:15530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783071522.174126:0:15530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783071522.174127:0:15530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783071522.174128:0:15530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783071522.174128:0:15530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783071522.174130:0:15530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783071522.174131:0:15530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783071522.174132:0:15530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783071522.174141:0:15530:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783071522.177313:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071522.178171:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783071522.178292:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071522.178389:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783071522.178616:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783071522.179283:0:15530:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783071522.180300:0:15530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1783071522.210387:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00080000:1.0:1783071522.212197:0:15530:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783071522.212205:0:15530:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783071522.212237:0:15530:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783071522.212286:0:15530:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783071522.212302:0:15530:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783071522.212329:0:15530:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1783071522.850252:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071523.874282:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783071524.064804:0:14225:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783071524.064812:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9781c65c5800 from 8 10000000:01000000:2.0:1783071524.064817:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783071524.064860:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071524.064872:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071524.064882:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071524.064905:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684526336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071524.065046:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071524.065089:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783071524.066152:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526336 00000100:00100000:3.0:1783071524.066162:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526336 00000100:00100000:3.0:1783071524.066205:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071524.066213:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684526336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071524.066226:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071524.066241:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec8392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec838b expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071524.066260:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec8392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec838b expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071524.066269:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97830217c800/0xd360fc6ce6ec8392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec838b expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071524.066276:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c800, rc 0) 00000100:00100000:3.0:1783071524.066319:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684526336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071524.066325:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783071524.066364:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684526336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783071524.066377:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8392 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071524.066384:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec8392 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071524.066435:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684526464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783071524.066471:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071524.066497:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fa976240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071524.066510:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526464 00000100:00100000:3.0:1783071524.066513:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526464 00000100:00100000:3.0:1783071524.066550:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071524.066557:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684526464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783071524.066570:0:14222:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783071524.066585:0:14222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783071524.066588:0:14222:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783071524.066661:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684526464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071524.066668:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783071524.066714:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684526464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783071524.066768:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783071524.066775:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8392 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071524.066783:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7939e00/0xd360fc6ce6ec838b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec8392 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071524.900636:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071525.219927:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071510/real 1783071510] req@ffff9781c77ca680 x1869685684519040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.219961:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c77ca680 x1869685684519040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.219972:0:3291:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783071510/real 1783071510] req@ffff9781c77c8000 x1869685684519168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.219983:0:3291:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9781c77c8000 x1869685684519168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783071525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783071525.220002:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782d68c6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071525.220028:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071525.220033:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684519040:0@lo:8:kworker.0 00000100:00080000:0.0:1783071525.220039:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9bab800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783071525.220045:0:3291:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783071525.220048:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684519168:0@lo:8:kworker.0 00000100:00080000:1.0:1783071525.220218:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071525.220222:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783071525.220225:0:8:0:(import.c:65:import_set_state_nolock()) ffff9782d68c6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071525.220230:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1783071525.220235:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783071525.220242:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9782d68c6000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071525.220260:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77cb100 x1869685684526720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783071525.220273:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783071525.220276:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783071525.220278:0:8:0:(import.c:65:import_set_state_nolock()) ffff9782f9bab800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783071525.220281:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1783071525.220283:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783071525.220287:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9782f9bab800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1783071525.220296:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9781c77cad80 x1869685684526848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783071525.220347:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684527104:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.220586:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684526976:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.220632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071525.220775:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071525.220783:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3295:1869685684526592:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.220814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.220978:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526592 00000100:00100000:2.0:1783071525.220986:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526592 00000100:00100000:2.0:1783071525.221029:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071525.221038:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3295:x1869685684526592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071525.221098:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3295:x1869685684526592:12345-0@lo:400:kworker.0 Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.221106:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783071525.221149:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684526720:0@lo:8:kworker.0 00000100:00100000:2.0:1783071525.221174:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.221197:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684526848:0@lo:8:kworker.0 00000100:00100000:2.0:1783071525.221218:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.221255:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526720 00000100:00100000:2.0:1783071525.221259:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526720 00000100:00100000:2.0:1783071525.221274:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526848 00000100:00100000:2.0:1783071525.221276:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526848 00000100:00100000:2.0:1783071525.221285:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071525.221290:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1869685684526720:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783071525.221312:0:14862:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1783071525.221337:0:14862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec8399 00002000:00100000:2.0:1783071525.221349:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9781c6071000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783071525.221353:0:14862:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783071525.221356:0:14862:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783071525.221788:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.221816:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071525.221824:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684527232:0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.221926:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.221963:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684526976 00000100:00100000:1.0:1783071525.221968:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684526976 00000100:00100000:1.0:1783071525.222005:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527104 00000100:00100000:1.0:1783071525.222008:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527104 00000100:00100000:1.0:1783071525.222032:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527232 00000100:00100000:1.0:1783071525.222041:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527232 00000100:00100000:1.0:1783071525.222059:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071525.222065:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684526976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.222103:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1869685684526976:12345-0@lo:400:kworker.0 Request processed in 38us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.222111:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783071525.222126:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071525.222131:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.222161:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869685684527104:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.222167:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071525.222178:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783071525.222184:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071525.222209:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684527232:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.222215:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783071525.222230:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783071525.222254:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77ca680 x1869685684527232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071525.222267:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684527232:0@lo:400:kworker.0 00010000:00080000:1.0:1783071525.222278:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77c8000 x1869685684527104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071525.222287:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1869685684527104:0@lo:400:kworker.0 00000100:00100000:0.0:1783071525.222571:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3295:1869685684526592:0@lo:400:kworker.0 00010000:00080000:0.0:1783071525.222584:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77c9c00 x1869685684526976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.222593:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1869685684526976:0@lo:400:kworker.0 00002000:00080000:2.0:1783071525.223237:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783071525.223263:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9781c6075800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071525.223311:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1869685684526720:12345-0@lo:8:kworker.0 Request processed in 2018us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.223319:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071525.223337:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071525.223342:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1869685684526848:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783071525.223363:0:14862:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00010000:00080000:0.0:1783071525.223580:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77cb100 x1869685684526720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.223590:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071525.223596:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783071525.223603:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783071525.223608:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783071525.223611:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782d68c6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783071525.223626:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783071525.223631:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684526720:0@lo:8:kworker.0 00000004:00080000:1.0:1783071525.223984:0:14251:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1783071525.224006:0:14251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1869685684527488:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783071525.224048:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.224069:0:14251:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9cdb300 going to sleep for 11 seconds 00000100:00100000:1.0:1783071525.224081:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684527360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071525.224103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783071525.224806:0:14862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd360fc6ce6ec83a0 00002000:00100000:2.0:1783071525.224823:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9781c6074800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783071525.224828:0:14862:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783071525.224831:0:14862:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783071525.225118:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783071525.225142:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9781c6073800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071525.225275:0:14864:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783071525.225283:0:14864:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1783071525.225889:0:14250:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783071525.226253:0:14250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426600578049ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783071525.227832:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527360 00000100:00100000:1.0:1783071525.227844:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527360 00000100:00100000:1.0:1783071525.227908:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071525.227918:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684527360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071525.227952:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071525.228029:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869685684527360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071525.228036:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783071525.228060:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783071525.228092:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77c8000 x1869685684527360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071525.228111:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684527360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071525.228158:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527488 00000100:00100000:1.0:1783071525.228162:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527488 00000100:00100000:1.0:1783071525.228246:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783071525.228253:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14251:x1869685684527488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783071525.241323:0:15760:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783071525.241335:0:15760:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1783071525.241341:0:15760:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1783071525.243536:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1869685684526848:12345-0@lo:8:kworker.0 Request processed in 20172us (22296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.243551:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783071525.244809:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c77cad80 x1869685684526848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783071545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783071525.244834:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783071525.244844:0:3291:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783071525.244923:0:3291:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783071525.244930:0:3291:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783071525.244934:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9782f9bab800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783071525.244953:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783071525.244960:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1869685684526848:0@lo:8:kworker.0 00000004:00080000:0.0:1783071525.244994:0:14252:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783071525.245357:0:14252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426619681711ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783071525.254648:0:14253:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1783071525.254944:0:14253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1869685684527744:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783071525.255018:0:14253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071525.255067:0:14253:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c6ac7180 going to sleep for 11 seconds 00000100:00100000:1.0:1783071525.257993:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684527616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071525.258069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071525.258151:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527744 00000100:00100000:1.0:1783071525.258159:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527744 00000100:00100000:2.0:1783071525.258822:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527616 00000100:00100000:2.0:1783071525.258829:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527616 00000100:00100000:2.0:1783071525.258943:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071525.258953:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684527616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783071525.258989:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071525.259043:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684527616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.259051:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783071525.259123:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783071525.260339:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783071525.260355:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14253:x1869685684527744:12345-0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1783071525.267922:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.267935:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.267953:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.267958:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.267964:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.267981:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.267992:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.267999:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268037:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071525.268574:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.268582:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268592:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.268596:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.268600:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268610:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268620:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268628:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.268646:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783071525.269102:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.269108:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269117:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.269127:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.269132:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269141:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269150:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269157:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269165:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783071525.269553:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.269560:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269568:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.269570:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.269574:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269582:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269590:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269603:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.269610:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783071525.270000:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.270007:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270015:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.270018:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.270022:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270031:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270040:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270047:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270056:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783071525.270410:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.270416:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270431:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.270434:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.270438:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270447:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270456:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270464:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.270471:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1783071525.270596:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783071525.270604:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270612:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270617:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270627:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270647:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270654:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8bc4fe/0xd360fc6ce6ec83a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270693:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783071525.270697:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270703:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270714:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270721:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270731:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270738:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000858b9fca/0xd360fc6ce6ec83ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270751:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783071525.270755:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270761:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270764:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270772:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270782:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270790:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134df1a1/0xd360fc6ce6ec83b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270810:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783071525.270814:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270820:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270823:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270832:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270844:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270851:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec83bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270863:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071525.270866:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270872:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270875:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270892:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270903:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270909:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec83c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270921:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.270924:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270930:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.270933:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270941:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270950:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270958:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c099829/0xd360fc6ce6ec83ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.270983:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.270985:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.270987:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1783071525.271042:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9781c51c5180 x1869685684527616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783071541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783071525.271065:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684527616:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1783071525.272419:0:14864:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783071525.272428:0:14864:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783071525.272434:0:14864:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1783071525.280359:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.280374:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.281023:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.281290:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.281296:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.281304:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.281322:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.281345:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.281352:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.281379:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.288159:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.288175:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.288191:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.288197:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.288209:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.288233:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.288241:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec83d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.288290:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.288291:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.288293:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.289614:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.289627:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.289643:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.289648:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.289655:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.289671:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.289698:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.289706:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.289806:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071525.291049:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.291061:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.291076:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.291080:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.291085:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.291097:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.291107:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.291114:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.291140:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071525.291429:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071525.291437:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291446:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.291450:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291469:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291487:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291495:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053352c87/0xd360fc6ce6ec83d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291518:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.291521:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291538:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.291549:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291558:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291568:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291575:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008edce6ba/0xd360fc6ce6ec83df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.291588:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.291590:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.291591:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.292377:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.292397:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292412:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.292416:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.292422:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292437:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292447:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292805:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292829:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.292843:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.292856:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292864:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.292869:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292879:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292894:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292901:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a304504/0xd360fc6ce6ec83e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.292918:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.292920:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.292921:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.293382:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.293826:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.293840:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.294265:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.294275:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294289:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294300:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294309:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294333:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.294350:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.294355:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294362:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.294366:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294375:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294549:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294556:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018430310/0xd360fc6ce6ec83ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.294578:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.294580:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.294582:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.295626:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.295638:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.295652:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.295664:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.295670:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.295698:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.295707:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.295715:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.296538:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.297151:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.297312:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.297321:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.297332:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.297338:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.297350:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.297370:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.297378:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc94b2ad/0xd360fc6ce6ec83f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.297843:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.297845:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.297925:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.299191:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1783071525.299603:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.299613:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299630:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.299634:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.299640:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299652:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299663:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299670:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299708:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.299799:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.299809:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.299812:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.299816:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.299826:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.299834:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299932:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.299939:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299958:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.299962:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299970:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299988:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.299995:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a67959/0xd360fc6ce6ec8402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.300014:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.300016:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.300018:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.300553:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.300581:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071525.301365:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.301373:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301577:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.301583:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301592:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.301596:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301605:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301631:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301639:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baee295b/0xd360fc6ce6ec83fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.301663:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.301665:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.301667:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.301810:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.301816:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.301823:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.301835:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.301844:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.301918:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.301948:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783071525.302428:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.302436:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.302451:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.302454:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.302556:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.302562:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302570:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0031000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.302574:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302584:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302600:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302608:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a568e45f/0xd360fc6ce6ec8409 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302636:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.302639:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.302640:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.302945:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.302951:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302960:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.302964:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.302968:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302978:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302986:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.302992:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303012:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.303022:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.303026:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303042:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.303045:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303052:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303063:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303069:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a741f80/0xd360fc6ce6ec8417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.303084:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.303086:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.303087:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.303704:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.303790:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.303802:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.303809:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.303833:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.304573:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.304580:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.304590:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.304595:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.304604:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.304628:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.304636:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047581a36/0xd360fc6ce6ec8410 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.304655:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.304657:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.304659:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.305038:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.305046:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305056:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.305059:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.305064:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305074:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305083:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305091:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305123:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.305133:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.305137:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305144:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.305147:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305155:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305166:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305172:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec841e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.305186:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.305188:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.305189:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.305991:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.306001:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.306012:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.306016:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.306021:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.306031:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.306054:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.306061:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.306086:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.306296:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.306303:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.306310:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0031400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.306320:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.306327:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.306340:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.306346:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1965fb4/0xd360fc6ce6ec8425 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.306362:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.306363:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.306365:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.309627:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.309644:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.309663:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.309668:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.309687:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.309704:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.309714:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071525.310327:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.310337:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.310348:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.310352:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.310356:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.310367:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.311136:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.311175:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.312001:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312020:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312038:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.312044:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312053:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.312058:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312069:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312090:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312099:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030306fa1/0xd360fc6ce6ec842c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.312123:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.312125:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.312127:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.312150:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071525.312209:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071525.312216:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.312237:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071525.312240:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.312248:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.312263:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.312271:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c88543b/0xd360fc6ce6ec8433 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.312303:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.312305:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.312308:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783071525.313302:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783071525.313313:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.313327:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.313332:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.313337:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.313350:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.313361:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.313389:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.313417:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783071525.313458:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071525.313467:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.313476:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071525.313481:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.313491:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.313516:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.313523:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e419114/0xd360fc6ce6ec843a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.313555:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.313557:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.313560:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.314415:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.314434:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.314447:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.314451:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.315607:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315644:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315657:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315666:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315699:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.315713:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.315960:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315971:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.315977:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.315988:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.316015:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.316024:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec8441 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.316046:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.316048:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.316050:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.318874:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.318892:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.318908:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.318912:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.318918:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.318933:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.318944:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.318952:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.318993:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.319009:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.319015:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.319023:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.319028:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.319038:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.319055:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.319063:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.319082:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.319084:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.319086:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.323069:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.323085:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.323104:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.323115:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.323122:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.323139:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.323149:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.323158:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.323179:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.323195:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.324059:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.324071:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.324076:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.324087:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.324105:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.324123:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dabde955/0xd360fc6ce6ec844f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.324143:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.324145:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.324147:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.326331:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.326341:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.326357:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.326361:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.326368:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.326382:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.326945:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.326955:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.326976:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.326992:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.327003:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.327012:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.327016:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.327025:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.327043:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.327051:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038e412eb/0xd360fc6ce6ec8456 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.327067:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.327068:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.327070:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783071525.328278:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.328290:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328306:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1783071525.328310:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071525.328317:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328341:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328351:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328360:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328376:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.328524:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.328540:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328548:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.328553:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328562:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328579:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328588:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e8c36d/0xd360fc6ce6ec845d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.328614:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.328616:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.328619:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783071525.333943:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1783071525.335540:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.335554:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.335572:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.335577:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.335583:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.335598:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.335609:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.335618:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.335651:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.336134:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.336143:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.336154:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.336159:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.336170:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.336188:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.336263:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8464 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.336284:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.336286:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.336287:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.339098:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.339112:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.339131:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.339145:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.339153:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.339172:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.339184:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.339193:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.339219:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783071525.339655:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.339663:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339692:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.339696:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.339701:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339712:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339773:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339783:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339801:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783071525.339814:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071525.339821:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339829:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071525.339841:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339852:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339870:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339877:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec846b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339896:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071525.339899:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339905:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:2.0:1783071525.339908:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339915:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339925:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339933:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec8472 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.339956:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.339958:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.339960:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.340581:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.340934:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.340943:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.340957:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.340960:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.340964:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.340974:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.340983:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.340998:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.341021:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.341545:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.341553:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.341563:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.341573:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.341583:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.341601:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.341608:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2eca35/0xd360fc6ce6ec8479 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.341628:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.341630:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.341631:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071525.342106:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.342115:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.342127:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.342131:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.342136:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.342147:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.342157:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.342165:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.342187:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.342594:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.342607:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.342614:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.342618:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.342625:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.342637:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.342643:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c873b37c/0xd360fc6ce6ec8480 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.342658:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.342659:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.342660:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.343210:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.343219:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.343229:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.343233:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.343237:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.343248:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.343258:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.343266:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.343285:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783071525.343981:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.343990:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.344012:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.344016:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.344021:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.344032:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.344042:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.344050:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.344072:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783071525.344287:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783071525.344295:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344304:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.344308:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344330:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344346:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344354:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344372:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.344376:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344382:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.344385:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344949:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344963:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.344971:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec848e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345001:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.345004:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.345006:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.345120:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.345129:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.345145:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.345148:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.345154:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.345165:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.345174:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.345182:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.345205:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.345548:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.345555:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345564:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cec00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.345568:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345578:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345592:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345600:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfe0b26f/0xd360fc6ce6ec8495 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.345616:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.345618:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.345619:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071525.345740:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.345747:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.345756:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.345759:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.345763:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.345773:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.345794:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.345802:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.345822:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.345829:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.345835:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.346269:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.346273:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.346283:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071525.346289:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783071525.346296:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.346297:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.346315:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec849c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.346318:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.346327:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.346333:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.346337:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.346340:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.346341:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.346534:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.347285:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.347294:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.347305:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.347308:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.347312:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.347323:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.347358:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.347366:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.347389:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071525.347755:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071525.347761:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.347770:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071525.347773:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.347782:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.347803:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.347810:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec84aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071525.347956:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.347959:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071525.347961:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.348117:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.348125:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.348132:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.348168:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.348331:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.348337:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.348345:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.348349:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.348358:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.348370:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.348385:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591f6c28/0xd360fc6ce6ec84a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.348694:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.348697:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.348700:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783071525.349209:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.349217:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.349229:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.349233:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.349239:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.349251:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.349260:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.349267:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.349978:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.349999:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.350006:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.350016:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.350020:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.350029:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.350045:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.350052:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a134835e/0xd360fc6ce6ec84b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.350074:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.350078:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.350080:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.350466:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.350474:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.350484:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.350488:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.350492:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.350503:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.350511:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.350518:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071525.351209:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.351217:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.351227:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.351237:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.351241:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.351253:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.351262:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.351269:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.351692:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783071525.352172:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.352185:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.352195:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.352198:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.352202:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.352213:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.352222:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.352237:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.352545:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783071525.353106:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.353114:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353126:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.353129:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.353134:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353145:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353156:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353163:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353172:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783071525.353589:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.353595:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353604:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.353612:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.353616:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353626:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353634:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353641:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.353648:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783071525.354103:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.354110:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354118:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.354121:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.354125:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354134:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354143:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354158:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354165:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783071525.354570:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.354576:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354584:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.354587:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.354591:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354601:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354608:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354616:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.354623:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1783071525.354769:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783071525.354781:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.354792:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.354797:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.354808:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.354829:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.354837:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad788723/0xd360fc6ce6ec84bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071525.355083:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.355090:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.355105:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.355108:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.355112:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.355120:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.355128:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.355135:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.355144:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1783071525.355278:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783071525.355284:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355292:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cea00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355295:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355304:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355330:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355338:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa8b5f9/0xd360fc6ce6ec84b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355358:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783071525.355362:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355369:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355372:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355378:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355538:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355549:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783071525.355552:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355559:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cee00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355569:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355578:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355589:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355597:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005645543f/0xd360fc6ce6ec84cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355611:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783071525.355615:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355622:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020ce800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355625:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355633:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355643:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355651:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077c56190/0xd360fc6ce6ec84d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355670:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783071525.355696:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355703:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf800 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355707:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355714:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355725:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355732:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8e435f/0xd360fc6ce6ec84db lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355744:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071525.355747:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355753:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cfc00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355756:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355774:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355784:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355791:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5eaa590/0xd360fc6ce6ec84e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355805:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.355808:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355814:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020ce200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.355817:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355825:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355834:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.355841:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4f5303/0xd360fc6ce6ec84e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.355889:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783071525.355897:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000242d7cfa/0xd360fc6ce6ec84c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783071525.356469:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.356476:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.356486:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.356490:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.356495:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.356506:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.356515:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.356522:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356558:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071525.356559:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.356562:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.356567:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356575:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.356580:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356588:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356601:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356608:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7940c57/0xd360fc6ce6ec84f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.356626:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.356629:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.356632:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.356647:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.356875:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.356882:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.356890:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.356893:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.356897:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.356907:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.356927:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.356935:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.356951:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783071525.357981:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.357990:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.358001:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.358005:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.358010:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.358021:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.358030:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.358037:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.358055:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783071525.358506:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.358513:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.358522:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.358536:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.358541:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.358552:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.358560:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.358566:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.358587:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783071525.358655:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783071525.358696:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358720:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.358724:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358734:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358754:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358761:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958b48ec/0xd360fc6ce6ec84f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358782:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783071525.358786:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358793:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.358795:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358803:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358815:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358828:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdec31c4/0xd360fc6ce6ec84fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.358844:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1783071525.359014:0:15760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783071525.359285:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.359293:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1783071525.359302:0:15760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071525.359306:0:15760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.359316:0:15760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.359324:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.359330:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071525.359805:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1783071525.360024:0:15760:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1783071525.360182:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360193:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cfa00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.360206:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360216:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360232:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360240:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1bba81/0xd360fc6ce6ec8505 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071525.360243:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.360252:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360258:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783071525.360263:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1783071525.360264:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.360273:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071525.360278:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071525.360281:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360292:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.360296:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360306:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.360309:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.360325:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360325:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360341:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e211a63f/0xd360fc6ce6ec850c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360355:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.360357:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.360358:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.360369:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071525.360443:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.360448:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.360453:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360639:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.360643:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360651:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360661:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360692:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adcf1b88/0xd360fc6ce6ec8513 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.360707:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.360709:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.360711:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783071525.361468:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.361476:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.361487:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.361496:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.361501:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.361512:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.361520:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.361627:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.361645:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783071525.361755:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.361761:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.361769:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.361773:0:14216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.361781:0:14216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.361794:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.361801:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b23b59/0xd360fc6ce6ec851a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783071525.362306:0:14864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783071525.362315:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.362328:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1783071525.362331:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071525.362336:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071525.362566:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14251:x1869685684527488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 134308us (138513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071525.362578:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783071525.362651:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.362660:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.362692:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.362696:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.362698:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071525.362798:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071525.362839:0:14864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783071525.363024:0:14251:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1869685684527488:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783071525.363045:0:14251:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00002000:00080000:3.0:1783071525.363053:0:14864:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1783071525.363098:0:14251:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1869685684527872:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783071525.363139:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783071525.363162:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071525.363169:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.363178:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071525.363182:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.363229:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.363247:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071525.363254:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8521 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071525.363257:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14253:x1869685684527744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102905us (108237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071525.363277:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783071525.363283:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.363286:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071525.363288:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071525.363569:0:14253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1869685684527744:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783071525.363577:0:14251:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c90edf00 going to sleep for 11 seconds 00000004:00080000:2.0:1783071525.363580:0:14253:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1783071525.363610:0:14253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1869685684528000:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783071525.363635:0:14253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071525.363727:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684527872 00000100:00100000:3.0:1783071525.363734:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684527872 00000100:00100000:3.0:1783071525.363782:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071525.363931:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14251:x1869685684527872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783071525.363976:0:14864:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1783071525.370289:0:14253:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c3d7ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783071525.370320:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528000 00000100:00100000:2.0:1783071525.370329:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528000 00000100:00100000:2.0:1783071525.370392:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071525.370404:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14253:x1869685684528000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783071525.370614:0:14862:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1783071525.371705:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783071525.374460:0:14251:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14251:1869685684527872:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783071525.374474:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14251:x1869685684527872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10621us (11272us total) trans 8589934593 rc 0/0 00000004:00080000:1.0:1783071525.374479:0:14251:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1783071525.374487:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071525.379980:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14253:x1869685684528000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9573us (16337us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783071525.379991:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071525.380054:0:14253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14253:1869685684528000:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783071525.380073:0:14253:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1783071525.921662:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071526.228595:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783071526.228611:0:6612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1783071526.949584:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071527.047845:0:15888:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:3.0:1783071527.721573:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1783071527.721587:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783071527.969854:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071528.917566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071528.917663:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667328 00000100:00100000:0.0:1783071528.917866:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667328 00000100:00100000:0.0:1783071528.920178:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:0.0:1783071528.920190:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1869685665667328:12345-192.168.202.16@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783071528.920226:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 596f4f5f-d33b-45b3-bf34-e08a5b83c5e6@192.168.202.16@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:0.0:1783071528.920271:0:14223:0:(genops.c:1406:class_connect()) connect: client 596f4f5f-d33b-45b3-bf34-e08a5b83c5e6, cookie 0xd360fc6ce6ec8528 00000100:00080000:0.0:1783071528.920401:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9781c4320000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783071528.920469:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+5:2354:x1869685665667328:12345-192.168.202.16@tcp:250:mount.lustre.0 Request processed in 280us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071528.920477:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:0.0:1783071528.922217:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.922326:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667456 00000100:00100000:2.0:1783071528.922334:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667456 00000100:00100000:2.0:1783071528.922466:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:2.0:1783071528.922478:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+5:13683:x1869685665667456:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071528.922493:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071528.922520:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec852f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcacb9 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.922546:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacb9 expref: 6 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.922558:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938200/0xd360fc6ce6ec852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacb9 expref: 6 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.922567:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938200, rc 0) 00000100:00100000:2.0:1783071528.922714:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+6:13683:x1869685665667456:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 195us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.922723:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:0.0:1783071528.927047:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.927133:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667584 00000100:00100000:2.0:1783071528.927143:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667584 00000100:00100000:2.0:1783071528.927203:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:2.0:1783071528.927212:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+6:13683:x1869685665667584:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783071528.927620:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+6:13683:x1869685665667584:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 408us (582us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783071528.927627:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:1.0:1783071528.931839:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.933032:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667712 00000100:00100000:2.0:1783071528.933044:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667712 00000100:00100000:2.0:1783071528.933110:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:2.0:1783071528.933122:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+6:13683:x1869685665667712:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071528.933139:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071528.933160:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec8536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcacc0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.933187:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec8536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacc0 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.933198:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938400/0xd360fc6ce6ec8536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacc0 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.933208:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938400, rc 0) 00000100:00100000:2.0:1783071528.933273:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+7:13683:x1869685665667712:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 153us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.933280:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:0.0:1783071528.935537:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071528.935623:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667840 00000100:00100000:3.0:1783071528.935632:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667840 00000100:00100000:3.0:1783071528.935780:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:3.0:1783071528.935791:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+7:13683:x1869685665667840:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071528.936100:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13683:x1869685665667840:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 311us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071528.936108:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:0.0:1783071528.938478:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.938620:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665667968 00000100:00100000:2.0:1783071528.938629:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665667968 00000100:00100000:2.0:1783071528.938749:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:2.0:1783071528.938760:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13683:x1869685665667968:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783071528.939156:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13683:x1869685665667968:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 396us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.939171:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:1.0:1783071528.941793:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.942066:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668096 00000100:00100000:2.0:1783071528.942076:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668096 00000100:00100000:2.0:1783071528.942130:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:2.0:1783071528.942140:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13702:x1869685665668096:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071528.942512:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13702:x1869685665668096:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 371us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.942521:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:0.0:1783071528.957839:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.957967:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668224 00000100:00100000:2.0:1783071528.957977:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668224 00000100:00100000:2.0:1783071528.958066:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:2.0:1783071528.958075:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13702:x1869685665668224:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071528.958342:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13702:x1869685665668224:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 267us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.958350:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:0.0:1783071528.966470:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071528.966645:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668352 00000100:00100000:3.0:1783071528.966656:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668352 00000100:00100000:3.0:1783071528.966748:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:3.0:1783071528.966758:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+8:13683:x1869685665668352:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783071528.966773:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071528.966790:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9783020cec00/0xd360fc6ce6ec853d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcacea expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.966816:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cec00/0xd360fc6ce6ec853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacea expref: 9 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.966826:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9783020cec00/0xd360fc6ce6ec853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacea expref: 9 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071528.966835:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cec00, rc 0) 00000100:00100000:3.0:1783071528.966893:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+9:13683:x1869685665668352:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 136us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071528.966900:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:1.0:1783071528.969762:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.969845:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668480 00000100:00100000:2.0:1783071528.969854:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668480 00000100:00100000:2.0:1783071528.969915:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:2.0:1783071528.969925:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+9:13683:x1869685665668480:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783071528.969951:0:14223:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783071528.969976:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783071528.969980:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783071528.969983:0:14223:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783071528.969986:0:14223:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783071528.971641:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+9:13683:x1869685665668480:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 1709us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.971661:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:0.0:1783071528.974894:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.974984:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668608 00000100:00100000:2.0:1783071528.974994:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668608 00000100:00100000:2.0:1783071528.975048:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:2.0:1783071528.975058:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+9:13683:x1869685665668608:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783071528.975075:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071528.975092:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcacf1 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.975118:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 10 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.975128:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 10 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071528.975137:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938a00, rc 0) 00000100:00100000:2.0:1783071528.975195:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13683:x1869685665668608:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071528.975202:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:1.0:1783071528.980392:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071528.980595:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668736 00000100:00100000:2.0:1783071528.980605:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668736 00000100:00100000:2.0:1783071528.980662:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:2.0:1783071528.980862:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13683:x1869685665668736:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783071528.981367:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13683:x1869685665668736:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 694us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071528.981387:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 86 00000100:00100000:0.0:1783071528.984639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071528.984833:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668864 00000100:00100000:3.0:1783071528.984844:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668864 00000100:00100000:3.0:1783071528.984915:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:3.0:1783071528.984925:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13683:x1869685665668864:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783071528.985337:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13683:x1869685665668864:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 412us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071528.985353:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 87 00000100:00100000:0.0:1783071528.998219:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1783071528.998492:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783071528.998595:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665668992 00000100:00100000:3.0:1783071528.998606:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665668992 00000100:00100000:3.0:1783071528.998662:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:3.0:1783071528.998813:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13704:x1869685665668992:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071529.002622:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13704:x1869685665668992:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 3941us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071529.002635:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:1.0:1783071529.006431:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071529.006635:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669120 00000100:00100000:2.0:1783071529.006645:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669120 00000100:00100000:2.0:1783071529.007878:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:2.0:1783071529.007892:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13704:x1869685665669120:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071529.008157:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13704:x1869685665669120:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 269us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071529.008166:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:0.0:1783071529.018999:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071529.019109:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669248 00000100:00100000:1.0:1783071529.019120:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669248 00000100:00100000:1.0:1783071529.019169:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1783071529.019178:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1869685665669248:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783071529.019208:0:14229:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8584ea24-866d-47dd-88c5-ae90837cb4cb@192.168.202.16@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1783071529.019255:0:14229:0:(genops.c:1406:class_connect()) connect: client 8584ea24-866d-47dd-88c5-ae90837cb4cb, cookie 0xd360fc6ce6ec854b 00000004:00100000:1.0:1783071529.019284:0:14229:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783071529.019290:0:14229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783071529.075030:0:14229:0:(import.c:65:import_set_state_nolock()) ffff9782c664d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071529.075114:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2354:x1869685665669248:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 55934us (56126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.075125:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1783071529.078941:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071529.079736:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669504 00000100:00100000:3.0:1783071529.079748:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669504 00000100:00100000:0.0:1783071529.079941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071529.080187:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669376 00000100:00100000:3.0:1783071529.080192:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669376 00000100:00100000:3.0:1783071529.080217:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1783071529.080226:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:13683:x1869685665669504:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071529.080270:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783071529.080348:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:13683:x1869685665669504:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 123us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.080357:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1783071529.080373:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1783071529.080379:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:0:x1869685665669376:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071529.080390:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783071529.080412:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:0:x1869685665669376:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.080417:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:2.0:1783071529.080582:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071529.086548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071529.088521:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669632 00000100:00100000:3.0:1783071529.088537:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669632 00000100:00100000:3.0:1783071529.088657:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071529.088669:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13683:x1869685665669632:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783071529.088802:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13683:x1869685665669632:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 135us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.088810:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071529.094606:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071529.094727:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669760 00000100:00100000:1.0:1783071529.094739:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669760 00000100:00100000:1.0:1783071529.094780:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1783071529.094789:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1869685665669760:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783071529.094821:0:14865:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8584ea24-866d-47dd-88c5-ae90837cb4cb@192.168.202.16@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1783071529.094850:0:14865:0:(genops.c:1406:class_connect()) connect: client 8584ea24-866d-47dd-88c5-ae90837cb4cb, cookie 0xd360fc6ce6ec8552 00002000:00100000:1.0:1783071529.094861:0:14865:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8584ea24-866d-47dd-88c5-ae90837cb4cb/ffff9781c63be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783071529.094885:0:14865:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783071529.095201:0:14865:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783071529.095229:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9781c63bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783071529.095740:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2354:x1869685665669760:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 948us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071529.095749:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1783071529.096747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071529.096836:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071529.097047:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670016 00000100:00100000:0.0:1783071529.097056:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670016 00000100:00100000:0.0:1783071529.097099:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1783071529.097107:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13683:x1869685665670016:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783071529.097721:0:14231:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 552us 00000100:00100000:3.0:1783071529.100705:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665669888 00000100:00100000:3.0:1783071529.100718:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665669888 00000100:00100000:3.0:1783071529.100778:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071529.100786:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869685665669888:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783071529.100828:0:15760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8584ea24-866d-47dd-88c5-ae90837cb4cb@192.168.202.16@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1783071529.100860:0:15760:0:(genops.c:1406:class_connect()) connect: client 8584ea24-866d-47dd-88c5-ae90837cb4cb, cookie 0xd360fc6ce6ec8559 00002000:00100000:3.0:1783071529.100874:0:15760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8584ea24-866d-47dd-88c5-ae90837cb4cb/ffff9782c664e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071529.100900:0:15760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071529.101219:0:15760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783071529.101254:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9782c664f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071529.101334:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2354:x1869685665669888:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 547us (4590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071529.101343:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000004:00200000:0.0:1783071529.118383:0:14231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783071529.118559:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13683:x1869685665670016:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 21446us (21716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071529.118569:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071529.308078:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071529.309483:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670144 00000100:00100000:0.0:1783071529.309515:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670144 00000100:00100000:0.0:1783071529.309582:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071529.309593:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13725:x1869685665670144:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:0.0:1783071529.309614:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071529.309638:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030000/0xd360fc6ce6ec8560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad1b expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.309721:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.309733:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.309743:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071529.309943:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783071529.309946:0:15543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071529.310014:0:15543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.310035:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030000/0xd360fc6ce6ec8560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad1b expref: 8 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.310049:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad1b expref: 7 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071529.310060:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:0.0:1783071529.310062:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071529.310064:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031000, rc 0) 00000100:00100000:0.0:1783071529.310133:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:13725:x1869685665670144:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 542us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071529.310140:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:0.0:1783071530.016952:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071530.721007:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071530.721044:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684528128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071530.721111:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721564:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684528384:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721632:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684528896:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721656:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721699:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071530.721705:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684528512:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721747:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684528256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721770:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721786:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684528768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071530.721802:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721812:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783071530.721817:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684528640:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071530.721854:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528896 00000100:00100000:1.0:1783071530.721860:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528896 00000100:00100000:1.0:1783071530.721897:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528512 00000100:00100000:1.0:1783071530.721899:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528512 00000100:00100000:1.0:1783071530.721908:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528640 00000100:00100000:1.0:1783071530.721910:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528640 00000100:00100000:1.0:1783071530.721923:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071530.721929:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684528896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.721971:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684528896:12345-0@lo:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071530.721993:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783071530.722007:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071530.722012:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.722034:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684528512:12345-0@lo:400:kworker.0 Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071530.722040:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071530.722048:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071530.722053:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684528640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.722074:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869685684528640:12345-0@lo:400:kworker.0 Request processed in 21us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071530.722079:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783071530.722105:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684528512:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.722113:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684528896:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.722136:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1869685684528640:0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.722208:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528128 00000100:00100000:2.0:1783071530.722212:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528128 00000100:00100000:2.0:1783071530.722231:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528768 00000100:00100000:2.0:1783071530.722233:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528768 00000100:00100000:2.0:1783071530.722244:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071530.722250:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684528128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071530.722274:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071530.722328:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684528128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.722334:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783071530.722344:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783071530.722350:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684528768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071530.722472:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528256 00000100:00100000:3.0:1783071530.722477:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528256 00002000:00000024:2.0:1783071530.722497:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071530.722515:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783071530.722521:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3293:x1869685684528256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783071530.722525:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684528768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071530.722531:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783071530.722546:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071530.722550:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3293:x1869685684528256:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00080000:2.0:1783071530.722550:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783071530.722552:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071530.722562:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783071530.722920:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3293:1869685684528256:0@lo:400:kworker.0 00000100:00100000:1.0:1783071530.722931:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783071530.722947:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684528768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783071530.722956:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783071530.722967:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c77c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684528128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071530.724640:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684528384 00000100:00100000:0.0:1783071530.724652:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684528384 00000100:00100000:0.0:1783071530.724744:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071530.724752:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684528384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071530.724817:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684528384:12345-0@lo:400:kworker.0 Request processed in 65us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071530.724823:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783071530.725007:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684528384:0@lo:400:kworker.0 00010000:00010000:1.0:1783071531.042868:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071531.146252:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071531.149100:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670272 00000100:00100000:1.0:1783071531.149116:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670272 00000100:00100000:1.0:1783071531.149208:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1783071531.149220:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:13778:x1869685665670272:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:1.0:1783071531.149263:0:14230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1783071531.149423:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071531.149692:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:13778:x1869685665670272:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 441us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071531.149701:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071531.152390:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.154418:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670400 00000100:00100000:2.0:1783071531.154432:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670400 00000100:00100000:2.0:1783071531.154536:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1783071531.154547:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13778:x1869685665670400:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:2.0:1783071531.154573:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071531.154669:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13778:x1869685665670400:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 124us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.154708:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00080000:0.0:1783071531.159202:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071531.159546:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.159645:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670528 00000100:00100000:2.0:1783071531.159655:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670528 00000100:00100000:2.0:1783071531.159756:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1783071531.159766:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13778:x1869685665670528:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:2.0:1783071531.159793:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783071531.159872:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:13778:x1869685665670528:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 107us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.159879:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00080000:0.0:1783071531.159937:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1783071531.295116:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8584ea24-866d-47dd-88c5-ae90837cb4cb 00000100:00100000:3.0:1783071531.337127:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.337241:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670656 00000100:00100000:0.0:1783071531.337253:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670656 00000100:00100000:0.0:1783071531.337355:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:0.0:1783071531.337365:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+10:13809:x1869685665670656:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783071531.337381:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071531.337408:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030400/0xd360fc6ce6ec856e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad22 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.337436:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030400/0xd360fc6ce6ec856e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad22 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.337463:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030400/0xd360fc6ce6ec856e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad22 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.337491:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030400, rc 0) 00000100:00100000:0.0:1783071531.337552:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665670656:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 188us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.337560:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:3.0:1783071531.351037:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.351347:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670784 00000100:00100000:2.0:1783071531.351357:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670784 00000100:00100000:2.0:1783071531.351425:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:2.0:1783071531.351434:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665670784:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783071531.353280:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665670784:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 1838us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.353292:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:1.0:1783071531.357914:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.358187:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665670912 00000100:00100000:0.0:1783071531.358199:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665670912 00000100:00100000:0.0:1783071531.358260:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:0.0:1783071531.358270:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665670912:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783071531.358517:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665670912:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 248us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.358526:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1783071531.361038:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071531.361104:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671040 00000100:00100000:3.0:1783071531.361111:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671040 00000100:00100000:3.0:1783071531.361159:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1783071531.361167:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13816:x1869685665671040:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783071531.361447:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13816:x1869685665671040:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 280us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.361453:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:3.0:1783071531.395000:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.395116:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671168 00000100:00100000:2.0:1783071531.395125:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671168 00000100:00100000:2.0:1783071531.395189:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:2.0:1783071531.395199:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13816:x1869685665671168:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071531.395589:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c42f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13816:x1869685665671168:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 389us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.395598:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:1.0:1783071531.419943:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.420043:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671296 00000100:00100000:0.0:1783071531.420052:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671296 00000100:00100000:0.0:1783071531.420109:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1783071531.420119:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13809:x1869685665671296:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783071531.420136:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071531.420152:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec8575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad4c expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.420190:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec8575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad4c expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.420202:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030200/0xd360fc6ce6ec8575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad4c expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.420227:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030200, rc 0) 00000100:00100000:0.0:1783071531.420286:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13809:x1869685665671296:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 169us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.420292:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 96 00000100:00100000:0.0:1783071531.425438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.425497:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671424 00000100:00100000:2.0:1783071531.425507:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671424 00000100:00100000:2.0:1783071531.425698:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:2.0:1783071531.425709:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13809:x1869685665671424:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783071531.425736:0:14220:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783071531.425828:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783071531.425833:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783071531.425835:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783071531.425837:0:14220:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783071531.429640:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13809:x1869685665671424:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 3921us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.429655:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 97 00000100:00100000:1.0:1783071531.436459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071531.436627:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671552 00000100:00100000:3.0:1783071531.436638:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671552 00000100:00100000:0.0:1783071531.436795:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:0.0:1783071531.436808:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13809:x1869685665671552:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783071531.436826:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071531.436845:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad53 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.436885:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.436897:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.436906:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030000, rc 0) 00000100:00100000:0.0:1783071531.437037:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13809:x1869685665671552:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 232us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.437044:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:0.0:1783071531.439151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.439268:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671680 00000100:00100000:2.0:1783071531.439275:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671680 00000100:00100000:2.0:1783071531.439363:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:2.0:1783071531.439373:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13809:x1869685665671680:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783071531.439707:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13809:x1869685665671680:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 335us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.439715:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:1.0:1783071531.441732:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.441857:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671808 00000100:00100000:0.0:1783071531.441866:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671808 00000100:00100000:0.0:1783071531.441952:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:0.0:1783071531.441962:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13809:x1869685665671808:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783071531.442259:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c7d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13809:x1869685665671808:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 298us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.442268:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:1.0:1783071531.444768:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.445106:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665671936 00000100:00100000:2.0:1783071531.445116:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665671936 00000100:00100000:2.0:1783071531.445206:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1783071531.445216:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13821:x1869685665671936:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783071531.445505:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13821:x1869685665671936:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 290us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.445513:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:2.0:1783071531.449871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.449973:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672064 00000100:00100000:0.0:1783071531.449982:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672064 00000100:00100000:0.0:1783071531.450037:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:0.0:1783071531.450046:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13821:x1869685665672064:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783071531.450360:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13821:x1869685665672064:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 314us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.450369:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:1.0:1783071531.464435:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071531.464585:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672192 00000100:00100000:3.0:1783071531.464595:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672192 00000100:00100000:3.0:1783071531.464732:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1783071531.464741:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1869685665672192:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783071531.464771:0:14228:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 571ce320-8198-4e7a-bd6a-735948ba4f6e@192.168.202.16@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1783071531.464817:0:14228:0:(genops.c:1406:class_connect()) connect: client 571ce320-8198-4e7a-bd6a-735948ba4f6e, cookie 0xd360fc6ce6ec8583 00000004:00100000:3.0:1783071531.464847:0:14228:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783071531.465286:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9782fabc1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071531.465363:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2354:x1869685665672192:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 622us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.465372:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1783071531.468931:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071531.468959:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071531.468988:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672448 00000100:00100000:3.0:1783071531.469011:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672448 00000100:00100000:2.0:1783071531.469060:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672320 00000100:00100000:2.0:1783071531.469064:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672320 00000100:00100000:3.0:1783071531.469149:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1783071531.469162:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:13809:x1869685665672448:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071531.469194:0:14229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783071531.469266:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:13809:x1869685665672448:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.469274:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1783071531.469293:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1783071531.469300:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:0:x1869685665672320:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783071531.469312:0:14229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783071531.469337:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:0:x1869685665672320:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.469343:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00080000:0.0:1783071531.469407:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071531.470806:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071531.470894:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672576 00000100:00100000:2.0:1783071531.470902:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672576 00000100:00100000:2.0:1783071531.470995:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1783071531.471005:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:13809:x1869685665672576:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783071531.471082:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:13809:x1869685665672576:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.471090:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1783071531.473960:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071531.474067:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672960 00000100:00100000:1.0:1783071531.474076:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672960 00000100:00100000:1.0:1783071531.474130:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1783071531.474140:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:13809:x1869685665672960:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783071531.474428:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783071531.475768:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:13809:x1869685665672960:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 1624us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071531.475778:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1783071531.482991:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071531.483070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071531.486639:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672704 00000100:00100000:3.0:1783071531.486657:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672704 00000100:00100000:2.0:1783071531.486794:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665672832 00000100:00100000:2.0:1783071531.486800:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665672832 00000100:00100000:2.0:1783071531.486961:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1783071531.486972:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869685665672832:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783071531.487008:0:14862:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 571ce320-8198-4e7a-bd6a-735948ba4f6e@192.168.202.16@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1783071531.487041:0:14862:0:(genops.c:1406:class_connect()) connect: client 571ce320-8198-4e7a-bd6a-735948ba4f6e, cookie 0xd360fc6ce6ec858a 00002000:00100000:2.0:1783071531.487053:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 571ce320-8198-4e7a-bd6a-735948ba4f6e/ffff9781c6070800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783071531.487066:0:14862:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783071531.487216:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783071531.487251:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9781c6077000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783071531.487378:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2354:x1869685665672832:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 405us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071531.487386:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1783071531.492042:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071531.492052:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869685665672704:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783071531.492082:0:15760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 571ce320-8198-4e7a-bd6a-735948ba4f6e@192.168.202.16@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1783071531.492108:0:15760:0:(genops.c:1406:class_connect()) connect: client 571ce320-8198-4e7a-bd6a-735948ba4f6e, cookie 0xd360fc6ce6ec8591 00002000:00100000:3.0:1783071531.492118:0:15760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 571ce320-8198-4e7a-bd6a-735948ba4f6e/ffff9782c87c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783071531.492127:0:15760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783071531.492353:0:15760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783071531.492395:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9782c87c3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783071531.492507:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2354:x1869685665672704:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 453us (9526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071531.492532:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1783071531.617050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071531.617214:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673088 00000100:00100000:0.0:1783071531.617225:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673088 00000100:00100000:0.0:1783071531.617295:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071531.617305:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:13842:x1869685665673088:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:0.0:1783071531.617326:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071531.617353:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec8598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad7d expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.617420:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.617434:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.617445:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071531.617879:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783071531.617884:0:15543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071531.617967:0:15543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.617995:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec8598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 8 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.618012:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 7 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071531.618021:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:0.0:1783071531.618024:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071531.618027:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030800, rc 0) 00000100:00100000:0.0:1783071531.618197:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:13842:x1869685665673088:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 892us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071531.618206:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:0.0:1783071532.066867:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783071532.450440:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1783071532.890562:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 571ce320-8198-4e7a-bd6a-735948ba4f6e 00000001:00100000:1.0:1783071532.890590:0:7495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8584ea24-866d-47dd-88c5-ae90837cb4cb 00010000:00010000:1.0:1783071533.089537:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783071534.114341:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783071534.121383:0:16091:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1783071534.354102:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 571ce320-8198-4e7a-bd6a-735948ba4f6e 00000001:00100000:2.0:1783071534.354118:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8584ea24-866d-47dd-88c5-ae90837cb4cb 00010000:00010000:1.0:1783071535.136972:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071535.841962:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071535.842033:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.842161:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529024 00000100:00100000:1.0:1783071535.842168:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529024 00000100:00100000:1.0:1783071535.842222:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071535.842232:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684529024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783071535.842265:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071535.842303:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1869685684529024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.842310:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783071535.842332:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684529152:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.842383:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684529664:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.842425:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071535.842430:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684529280:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842466:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783071535.842492:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783071535.842508:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529152 00000100:00100000:1.0:1783071535.842512:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529152 00000100:00100000:1.0:1783071535.842539:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071535.842545:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3292:x1869685684529152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842586:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3292:x1869685684529152:12345-0@lo:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.842593:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783071535.842620:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529664 00000100:00100000:1.0:1783071535.842623:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529664 00000100:00100000:1.0:1783071535.842651:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071535.842658:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684529664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842711:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869685684529664:12345-0@lo:400:kworker.0 Request processed in 53us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.842717:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783071535.842734:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529280 00000100:00100000:1.0:1783071535.842737:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529280 00000100:00100000:1.0:1783071535.842763:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071535.842769:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684529280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842796:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869685684529280:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.842801:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071535.842830:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684529408:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.842946:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783071535.842951:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684529536:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.842975:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.842998:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529408 00000100:00100000:1.0:1783071535.843001:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529408 00000100:00100000:1.0:1783071535.843020:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529536 00000100:00100000:1.0:1783071535.843022:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529536 00000100:00100000:1.0:1783071535.843038:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071535.843051:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684529408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843083:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c77ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869685684529408:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.843088:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783071535.843099:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783071535.843105:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843128:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684529536:12345-0@lo:400:kworker.0 Request processed in 24us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.843134:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783071535.843149:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783071535.843152:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071535.843177:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684529536:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843187:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869685684529408:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843220:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783071535.843239:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1869685684529280:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843246:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684529152:0@lo:400:kworker.0 00000100:00100000:1.0:1783071535.843255:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1869685684529664:0@lo:400:kworker.0 00000100:00100000:2.0:1783071535.844062:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684529792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783071535.844097:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071535.844154:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684529792 00000100:00100000:1.0:1783071535.844159:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684529792 00000100:00100000:1.0:1783071535.844187:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783071535.844193:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684529792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783071535.844218:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071535.849339:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684529792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5134us (5229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071535.849360:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783071535.849494:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fac88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684529792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783071536.160756:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783071536.441697:0:6612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 571ce320-8198-4e7a-bd6a-735948ba4f6e 00000100:00100000:1.0:1783071536.581532:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.581709:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.581742:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.581770:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.581792:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.581809:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071536.581860:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673600 00000100:00100000:3.0:1783071536.581879:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673600 00000100:00100000:3.0:1783071536.581933:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673856 00000100:00100000:3.0:1783071536.581936:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673856 00000100:00100000:3.0:1783071536.581950:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673472 00000100:00100000:3.0:1783071536.581953:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673472 00000100:00100000:3.0:1783071536.581967:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1783071536.581978:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2358:x1869685665673600:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071536.582036:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673216 00000100:00100000:0.0:1783071536.582040:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673216 00000100:00100000:3.0:1783071536.582063:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2358:x1869685665673600:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 86us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071536.582069:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1783071536.582070:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1783071536.582075:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:2358:x1869685665673216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071536.582085:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1783071536.582090:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2358:x1869685665673856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071536.582101:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:2358:x1869685665673216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.582108:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2358:x1869685665673856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071536.582108:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:3.0:1783071536.582113:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1783071536.582122:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1783071536.582127:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2358:x1869685665673472:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071536.582146:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2358:x1869685665673472:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 19us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.582151:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1783071536.582399:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071536.582492:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673984 00000100:00100000:1.0:1783071536.582497:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673984 00000100:00100000:1.0:1783071536.582519:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071536.582526:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2358:x1869685665673984:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1783071536.582559:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2358:x1869685665673984:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071536.582565:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00080000:1.0:1783071536.582585:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783071536.582589:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071536.583606:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673344 00000100:00100000:2.0:1783071536.583614:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673344 00000100:00100000:2.0:1783071536.583687:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665673728 00000100:00100000:2.0:1783071536.583691:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665673728 00000100:00100000:2.0:1783071536.583717:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1783071536.583724:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fac8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2358:x1869685665673344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071536.583770:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fac8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2358:x1869685665673344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.583771:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00080000:0.0:1783071536.583819:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783071536.583998:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2358:x1869685665673728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071536.584140:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2358:x1869685665673728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 355us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071536.584166:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1783071536.584200:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000020:00000080:2.0:1783071536.693659:0:16244:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeefd9dd60 20000000:00000080:2.0:1783071536.693809:0:16244:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9781c6ad6c00 uarg=0000000000000000 20000000:01000000:2.0:1783071536.693848:0:16244:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783071536.693854:0:16244:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783071536.693859:0:16244:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783071536.694637:0:16245:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1783071536.694844:0:16244:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783071536.703742:0:16244:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783071536.703770:0:16244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703790:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703798:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703805:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703814:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703821:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703829:0:16244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703872:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.703904:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 12 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071536.703920:0:16244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684529920:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071536.704030:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.704039:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071536.705274:0:16244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530048:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071536.705358:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.705369:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071536.705379:0:16244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530176:0@lo:104: 00000100:00100000:3.0:1783071536.705416:0:16244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783071536.705454:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.705462:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071536.705471:0:16244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530304:0@lo:104: 00000100:00100000:3.0:1783071536.705492:0:16244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071536.705531:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530176 00000100:00100000:3.0:1783071536.705538:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530176 00000100:00100000:3.0:1783071536.705576:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530304 00000100:00100000:3.0:1783071536.705579:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530304 00000100:00100000:3.0:1783071536.705593:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071536.705600:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+4:16244:x1869685684530176:12345-0@lo:104: 00010000:00010000:3.0:1783071536.705613:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.705666:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783071536.705704:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+4:16244:x1869685684530176:12345-0@lo:104: Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.705712:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783071536.705730:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783071536.705737:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:16244:x1869685684530304:12345-0@lo:104: 00010000:00010000:3.0:1783071536.705745:0:14211:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.705776:0:14211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783071536.705781:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+3:16244:x1869685684530304:12345-0@lo:104: Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.705786:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783071536.707978:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.707994:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071536.708008:0:16244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530432:0@lo:104: 00000100:00100000:2.0:1783071536.708083:0:16244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071536.708108:0:16244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fd39ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783071536.708129:0:16244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530176:0@lo:104: 00000100:00100000:2.0:1783071536.708138:0:16244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530304:0@lo:104: 00010000:00010000:2.0:1783071536.708162:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783071536.708167:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708175:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9a00 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071536.708179:0:14216:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708385:0:14216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071536.708393:0:14216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071536.708398:0:14216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071536.708429:0:14216:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708446:0:14216:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071536.708483:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708490:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9a00/0xd360fc6ce6ec8353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec835a expref: -99 pid: 15530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708503:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783071536.708507:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708512:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9600 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:2.0:1783071536.708515:0:14216:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708522:0:14216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783071536.708528:0:14216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071536.708533:0:14216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783071536.708547:0:14216:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708553:0:14216:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783071536.708558:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708564:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782fa7b9600/0xd360fc6ce6ec82e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec82ea expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708582:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071536.708584:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071536.708586:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783071536.708616:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071536.708644:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684530560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071536.708699:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071536.708726:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783071536.708731:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684530688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071536.708752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071536.708792:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530560 00000100:00100000:2.0:1783071536.708803:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530560 00010000:00010000:2.0:1783071536.708833:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 19 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071536.708857:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530688 00000100:00100000:2.0:1783071536.708860:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530688 00010000:00010000:2.0:1783071536.708873:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 20 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071536.708887:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071536.708894:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+20:3294:x1869685684530560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071536.708906:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071536.708911:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 20 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708920:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 20 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708945:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938000/0xd360fc6ce6ec835a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec8353 expref: 20 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.708957:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071536.708993:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3294:x1869685684530560:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071536.709000:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783071536.709018:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071536.709024:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:3294:x1869685684530688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783071536.709032:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071536.709037:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071536.709236:0:14212:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783071536.709249:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530432 00000100:00100000:0.0:1783071536.709252:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530432 00000100:00100000:0.0:1783071536.709273:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071536.709280:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c677a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+4:16244:x1869685684530432:12345-0@lo:104: 00010000:00010000:0.0:1783071536.709289:0:14212:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709330:0:14212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783071536.709336:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c677a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+4:16244:x1869685684530432:12345-0@lo:104: Request processed in 57us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071536.709343:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783071536.709357:0:14216:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783071536.709361:0:14216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709366:0:14216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2000 already unused, calling callback (ffffffffc1ce4c20) 10000000:00010000:0.0:1783071536.709369:0:14216:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709375:0:14216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783071536.709381:0:14216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783071536.709386:0:14216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783071536.709404:0:14216:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709420:0:14216:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783071536.709448:0:14216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709455:0:14216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec8296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd360fc6ce6ec829d expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709469:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071536.709470:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071536.709473:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783071536.709483:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684530816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783071536.709510:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071536.709545:0:14213:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783071536.709551:0:14213:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783071536.709600:0:16244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530432:0@lo:104: 00010000:00010000:2.0:1783071536.709646:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.709657:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7939600/0xd360fc6ce6ec82ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec82e3 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.709666:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071536.709730:0:14215:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783071536.709738:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530816 00000100:00100000:0.0:1783071536.709742:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530816 00010000:00010000:0.0:1783071536.709756:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071536.709769:0:14215:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783071536.709776:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071536.709784:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:3292:x1869685684530816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783071536.709793:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071536.709798:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709817:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709829:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97830217c000/0xd360fc6ce6ec829d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd360fc6ce6ec8296 expref: 18 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.709839:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071536.709873:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:3292:x1869685684530816:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071536.709881:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783071536.709914:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684530816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071536.709987:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:3294:x1869685684530688:12345-0@lo:103:ldlm_bl.0 Request processed in 963us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071536.709993:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783071536.710038:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684530688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071536.710116:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3294:1869685684530560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783071536.710837:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071536.710939:0:16244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684529920:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071536.711021:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674112 00000100:00100000:3.0:1783071536.711027:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674112 00010000:00010000:3.0:1783071536.711114:0:14215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071536.711169:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071536.711177:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:2358:x1869685665674112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071536.711196:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071536.711201:0:14215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.711211:0:14215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.711225:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec857c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad53 expref: 13 pid: 14222 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071536.711236:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071536.711283:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:2358:x1869685665674112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 106us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071536.711291:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1783071536.712305:0:16244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16244:1869685684530048:192.168.202.16@tcp:104: 00010000:00010000:0.0:1783071536.712337:0:16244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071536.712658:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071536.712787:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674240 00000100:00100000:0.0:1783071536.712794:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674240 00010000:00010000:0.0:1783071536.712818:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071536.712911:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071536.712920:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:2357:x1869685665674240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071536.712932:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071536.712938:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.712964:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.712979:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9782c7938a00/0xd360fc6ce6ec8544 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcacf1 expref: 12 pid: 14220 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.712992:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713000:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713015:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713022:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713030:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713037:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713109:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071536.713114:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713122:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713152:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071536.713161:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071536.713205:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:2357:x1869685665674240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 285us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071536.713212:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:2.0:1783071536.713258:0:16244:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.713266:0:16244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071536.713272:0:16244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9783020cf000/0xd360fc6ce6ec85a6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071537.186132:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783071538.208860:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783071538.400769:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783071538.400775:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c7f0b800 from 10 10000000:01000000:0.0:1783071538.400779:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783071538.400826:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.400838:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.400849:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071538.400870:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684530944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.400926:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071538.400977:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783071538.401061:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684530944 00000100:00100000:3.0:1783071538.401068:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684530944 00000100:00100000:0.0:1783071538.401308:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783071538.401319:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4982450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+16:14225:x1869685684530944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071538.401332:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071538.401344:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec85b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec85ad expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.401385:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec85b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85ad expref: 17 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.401395:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0031400/0xd360fc6ce6ec85b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85ad expref: 17 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.401404:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0031400, rc 0) 00000100:00100000:0.0:1783071538.401461:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4982450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684530944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071538.401469:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783071538.401550:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684530944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783071538.401560:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85b4 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071538.401566:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec85b4 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071538.401606:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071538.401625:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071538.401645:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cbf190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071538.401695:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531072 00000100:00100000:3.0:1783071538.401698:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531072 00000100:00100000:3.0:1783071538.401720:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783071538.401725:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684531072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071538.401931:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684531072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071538.401936:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783071538.401986:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783071538.402006:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783071538.402033:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071538.402050:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cbf190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783071538.402072:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531200 00000100:00100000:1.0:1783071538.402077:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531200 00000100:00100000:1.0:1783071538.402107:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783071538.402125:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684531200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.402272:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684531200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.402277:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783071538.402358:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783071538.402981:0:16354:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783071538.403096:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783071538.403110:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783071538.403119:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85b4 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071538.403136:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c0030a00/0xd360fc6ce6ec85ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85b4 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783071538.403145:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783071538.403147:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9782c3016000 from 10 10000000:01000000:2.0:1783071538.403149:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783071538.403168:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071538.403174:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071538.403179:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071538.403190:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783071538.403219:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071538.403274:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782cbf19300 going to sleep for 11 seconds 00000100:00100000:0.0:1783071538.405763:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531328 00000100:00100000:0.0:1783071538.405777:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531328 00000100:00100000:0.0:1783071538.405836:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071538.405846:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+17:14225:x1869685684531328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071538.405862:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071538.405879:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec85c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec85bb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.405906:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec85c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85bb expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.405917:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c0030000/0xd360fc6ce6ec85c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85bb expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.405926:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030000, rc 0) 00000100:00100000:0.0:1783071538.406009:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071538.406016:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783071538.406074:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783071538.406093:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85c2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071538.406102:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec85c2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071538.406163:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.406194:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071538.406220:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b780 going to sleep for 11 seconds 00000100:00100000:3.0:1783071538.406290:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531456 00000100:00100000:3.0:1783071538.406294:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531456 00000100:00100000:3.0:1783071538.406325:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783071538.406333:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071538.406585:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071538.406599:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783071538.406698:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.406727:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.406765:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071538.406782:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783071538.406970:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531584 00000100:00100000:1.0:1783071538.406975:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531584 00000100:00100000:1.0:1783071538.407019:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783071538.407028:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.407181:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.407188:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783071538.407225:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783071538.407908:0:16355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783071538.407961:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783071538.407976:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071538.407985:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85c2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.407995:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c7938c00/0xd360fc6ce6ec85bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85c2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783071538.408005:0:14225:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783071538.408008:0:14225:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9781c65c5800 from 10 10000000:01000000:1.0:1783071538.408011:0:14225:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783071538.408035:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408043:0:14225:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408052:0:14225:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071538.408069:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408103:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071538.408127:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9781c40bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1783071538.408140:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531712 00000100:00100000:1.0:1783071538.408144:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531712 00000100:00100000:1.0:1783071538.408165:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071538.408171:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+18:14225:x1869685684531712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071538.408181:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071538.408191:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb2800/0xd360fc6ce6ec85d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd360fc6ce6ec85c9 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408209:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb2800/0xd360fc6ce6ec85d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85c9 expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408217:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb2800/0xd360fc6ce6ec85d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd360fc6ce6ec85c9 expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408224:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2800, rc 0) 00000100:00100000:1.0:1783071538.408250:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684531712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.408256:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783071538.408287:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071538.408299:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85d0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.408308:0:14225:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd360fc6ce6ec85d0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071538.408346:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408369:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071538.408388:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4b67000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071538.408399:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531840 00000100:00100000:1.0:1783071538.408402:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531840 00000100:00100000:1.0:1783071538.408418:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783071538.408434:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684531840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408623:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684531840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.408630:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783071538.408657:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408708:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408743:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071538.408756:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4b67000 going to sleep for 11 seconds 00000100:00100000:1.0:1783071538.408767:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684531968 00000100:00100000:1.0:1783071538.408771:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684531968 00000100:00100000:1.0:1783071538.408787:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783071538.408793:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684531968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.408908:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:14225:x1869685684531968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.408916:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783071538.408951:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:14225:1869685684531968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783071538.409632:0:16356:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783071538.409697:0:14225:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783071538.409712:0:14225:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783071538.409720:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85d0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.409741:0:14225:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9782c9fb2000/0xd360fc6ce6ec85c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd360fc6ce6ec85d0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071538.431243:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071538.432105:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674368 00000100:00100000:1.0:1783071538.432116:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674368 00000100:00100000:1.0:1783071538.432165:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:1.0:1783071538.432174:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+11:13697:x1869685665674368:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071538.432190:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071538.432208:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb2e00/0xd360fc6ce6ec85d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad84 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.432236:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb2e00/0xd360fc6ce6ec85d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad84 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.432245:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb2e00/0xd360fc6ce6ec85d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad84 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.432254:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2e00, rc 0) 00000100:00100000:1.0:1783071538.432325:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674368:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 151us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.432332:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 114 00000100:00100000:0.0:1783071538.442781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071538.442875:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674496 00000100:00100000:3.0:1783071538.442886:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674496 00000100:00100000:3.0:1783071538.442945:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1783071538.442955:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674496:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783071538.443256:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674496:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 301us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071538.443264:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1783071538.445292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071538.445478:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674624 00000100:00100000:0.0:1783071538.445485:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674624 00000100:00100000:0.0:1783071538.445534:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:0.0:1783071538.445543:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674624:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.445791:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674624:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 248us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071538.445800:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:2.0:1783071538.453109:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071538.456320:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674752 00000100:00100000:1.0:1783071538.456336:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674752 00000100:00100000:1.0:1783071538.456524:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:1.0:1783071538.456537:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+12:13697:x1869685665674752:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783071538.456555:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071538.456587:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec85de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad8b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.456620:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec85de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad8b expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.456629:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9782c9fb2a00/0xd360fc6ce6ec85de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad8b expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071538.456638:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb2a00, rc 0) 00000100:00100000:1.0:1783071538.456728:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13697:x1869685665674752:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 194us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.456735:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:2.0:1783071538.466286:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071538.466385:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665674880 00000100:00100000:0.0:1783071538.466396:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665674880 00000100:00100000:0.0:1783071538.466458:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1783071538.466469:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13697:x1869685665674880:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783071538.466800:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13697:x1869685665674880:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 331us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071538.466808:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:2.0:1783071538.475280:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071538.475382:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675008 00000100:00100000:1.0:1783071538.475392:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675008 00000100:00100000:1.0:1783071538.475463:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1783071538.475473:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13697:x1869685665675008:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783071538.475722:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:13697:x1869685665675008:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 249us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071538.475731:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:2.0:1783071539.184146:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.184246:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675136 00000100:00100000:1.0:1783071539.184256:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675136 00000100:00100000:1.0:1783071539.184366:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1783071539.184374:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:14353:x1869685665675136:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071539.184398:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.184431:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec85e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad92 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184498:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184508:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184517:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184536:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184543:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.184550:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185208:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec85fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185220:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec85fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185228:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec85fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.185308:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783071539.185312:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071539.185400:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec85fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185434:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185441:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185448:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185454:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.185458:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185465:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185479:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:1.0:1783071539.185482:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.185487:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185493:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec85ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185505:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185512:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185518:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185529:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.185532:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185538:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185546:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.185549:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.185551:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185557:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec85f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185592:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec85e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad92 expref: 8 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185605:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3200/0xd360fc6ce6ec85fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad92 expref: 7 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.185610:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782c4fabd00) 00010000:00010000:1.0:1783071539.185612:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071539.185613:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3200, rc 0) 00000100:00100000:1.0:1783071539.186092:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:14353:x1869685665675136:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1716us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.186099:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:0.0:1783071539.186354:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783071539.193316:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.193646:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675392 00000100:00100000:3.0:1783071539.193658:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675392 00000100:00100000:3.0:1783071539.194060:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1783071539.194074:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:14353:x1869685665675392:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071539.194096:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071539.194119:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf400/0xd360fc6ce6ec8601 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcad99 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194288:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194302:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194314:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194663:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194705:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.194712:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.195357:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf200/0xd360fc6ce6ec8616 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.195766:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf200/0xd360fc6ce6ec8616 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.195776:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf200/0xd360fc6ce6ec8616 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071539.195787:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783071539.196088:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196095:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196101:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196106:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071539.196110:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196116:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196138:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9782c4fabd00) 00010000:00010000:3.0:1783071539.196141:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071539.196145:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196151:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec8608 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196162:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196167:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196172:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196176:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cfa00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071539.196179:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196183:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196189:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9782d91c2000) 00010000:00010000:3.0:1783071539.196192:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071539.196194:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196198:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec860f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196802:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf400/0xd360fc6ce6ec8601 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad99 expref: 10 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196818:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf200/0xd360fc6ce6ec8616 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad99 expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.196826:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782d91c2e00) 00010000:00010000:3.0:1783071539.196829:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071539.196831:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cf200, rc 0) 00000100:00100000:3.0:1783071539.196894:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14353:x1869685665675392:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2824us (3586us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783071539.196903:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1783071539.199462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.199950:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675520 00000100:00100000:1.0:1783071539.200628:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675520 00000100:00100000:1.0:1783071539.200729:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1783071539.201479:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14353:x1869685665675520:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783071539.201666:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14353:x1869685665675520:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 927us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.201699:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1783071539.230132:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.230724:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675648 00000100:00100000:0.0:1783071539.230735:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675648 00000100:00100000:0.0:1783071539.230790:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1783071539.230800:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14359:x1869685665675648:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071539.230822:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071539.230843:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec8624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcada0 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230904:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230918:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230929:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230943:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230951:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.230972:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231207:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231215:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231221:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231227:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c0030c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071539.231231:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231238:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231250:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:0.0:1783071539.231253:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071539.231256:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231262:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030c00/0xd360fc6ce6ec862b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231272:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231278:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231288:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231293:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071539.231296:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231302:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231310:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9782d98a7000) 00010000:00010000:0.0:1783071539.231312:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071539.231315:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231321:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8632 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231348:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec8624 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcada0 expref: 10 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231358:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:0.0:1783071539.231360:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071539.231363:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030600/0xd360fc6ce6ec8624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcada0 expref: 10 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.231484:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c0030600, rc 0) 00000100:00100000:0.0:1783071539.231544:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14359:x1869685665675648:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 744us (1422us total) trans 0 rc 301/301 00000100:00100000:0.0:1783071539.231560:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00010000:00010000:2.0:1783071539.232899:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071539.236427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.236636:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665675776 00000100:00100000:3.0:1783071539.236646:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665675776 00000100:00100000:3.0:1783071539.236736:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1783071539.236747:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14359:x1869685665675776:12345-192.168.202.16@tcp:700:lfs.0 00000100:00100000:3.0:1783071539.236835:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14359:x1869685665675776:12345-192.168.202.16@tcp:700:lfs.0 Request processed in 90us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071539.236843:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1783071539.241178:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.241545:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676032 00000100:00100000:1.0:1783071539.241556:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676032 00000100:00100000:1.0:1783071539.241613:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1783071539.241623:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14359:x1869685665676032:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:1.0:1783071539.242030:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071539.242059:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0031000/0xd360fc6ce6ec8567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad1b expref: 9 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.242080:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:1.0:1783071539.242085:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071539.242651:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.242667:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 5 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.242726:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.242760:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 5 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.242797:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 5 pid: 15543 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.242812:0:14228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684532096:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071539.242916:0:14228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782fd39a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783071539.246337:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.246425:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676160 00000100:00100000:3.0:1783071539.246434:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676160 00010000:00010000:3.0:1783071539.246487:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 6 pid: 15543 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071539.246524:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1783071539.246533:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2357:x1869685665676160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071539.246563:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071539.246570:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 6 pid: 15543 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.246584:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 6 pid: 15543 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.246605:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:3.0:1783071539.246610:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.246620:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.246627:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783071539.246703:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783071539.246919:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071539.247183:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2357:x1869685665676160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 649us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071539.247191:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00010000:00010000:1.0:1783071539.247736:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c0030800/0xd360fc6ce6ec859f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcad7d expref: 5 pid: 15543 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.247754:0:14228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684532096:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071539.247775:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.247784:0:14228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.247790:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.247813:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.247824:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.247838:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.253012:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783071539.253041:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253049:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253055:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253059:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.253062:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253066:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253079:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782d98a7600) 00010000:00010000:1.0:1783071539.253081:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.253084:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.253088:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec8639 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071539.253101:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d5bb002 reply state 000000002ae54fcd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.253107:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071539.253188:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+10:14359:x1869685665676032:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 11563us (12015us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783071539.253197:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00010000:00010000:1.0:1783071539.259107:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259131:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259140:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259146:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.259151:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259160:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259177:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.259181:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.259185:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.259192:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8640 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071539.350235:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.350304:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676288 00000100:00100000:1.0:1783071539.350314:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676288 00000100:00100000:1.0:1783071539.350440:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1783071539.350452:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14367:x1869685665676288:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:1.0:1783071539.350489:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.350514:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcada7 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350602:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec864e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350621:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350632:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.350716:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783071539.350720:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071539.350762:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350786:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcada7 expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350800:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3800/0xd360fc6ce6ec864e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcada7 expref: 10 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.350808:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.350811:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071539.350815:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3800, rc 0) 00000100:00100000:1.0:1783071539.350880:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+10:14367:x1869685665676288:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 430us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.350887:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1783071539.374942:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.375052:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676416 00000100:00100000:1.0:1783071539.375062:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676416 00000100:00100000:1.0:1783071539.375130:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1783071539.375140:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:14368:x1869685665676416:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.375161:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.375180:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadae expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375238:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec865c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375251:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375262:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.375317:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783071539.375321:0:15543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071539.375342:0:15543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec865c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375363:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadae expref: 7 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375395:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3600/0xd360fc6ce6ec865c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadae expref: 6 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.375403:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.375405:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071539.375408:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3600, rc 0) 00000100:00100000:1.0:1783071539.375476:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:14368:x1869685665676416:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 337us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.375489:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1783071539.377868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.378017:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676544 00000100:00100000:0.0:1783071539.378026:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676544 00000100:00100000:0.0:1783071539.378071:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1783071539.378080:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:14368:x1869685665676544:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1783071539.378097:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071539.378115:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec8663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadb5 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378171:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378184:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378194:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378208:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378214:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378220:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378343:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378362:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378380:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071539.378427:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783071539.378430:0:14229:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783071539.378453:0:14229:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378464:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378470:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378476:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378482:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071539.378486:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378493:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378503:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:0.0:1783071539.378506:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071539.378510:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378524:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec866a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378538:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378544:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378549:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378554:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071539.378557:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378563:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378570:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9782d98a7000) 00010000:00010000:0.0:1783071539.378573:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783071539.378575:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378580:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec8671 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378607:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec8663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadb5 expref: 8 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378632:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadb5 expref: 7 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.378638:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782d98a7500) 00010000:00010000:0.0:1783071539.378641:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783071539.378643:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c000, rc 0) 00000100:00100000:0.0:1783071539.378725:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:14368:x1869685665676544:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 646us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071539.378733:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1783071539.382920:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.383029:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665676800 00000100:00100000:1.0:1783071539.383040:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665676800 00000100:00100000:1.0:1783071539.383096:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1783071539.383106:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:14368:x1869685665676800:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.383125:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.383142:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec867f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadbc expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.383249:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783071539.383358:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec867f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadbc expref: 9 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.383373:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.383377:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071539.383382:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec867f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadbc expref: 9 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.383395:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071539.383467:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+8:14368:x1869685665676800:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 363us (566us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783071539.383474:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1783071539.385542:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.385621:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665677056 00000100:00100000:0.0:1783071539.385629:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665677056 00000100:00100000:0.0:1783071539.385710:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1783071539.385719:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+8:14368:x1869685665677056:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1783071539.385761:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071539.385782:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8678 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadb5 expref: 8 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.385796:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782d98a7500) 00010000:00010000:0.0:1783071539.385803:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783071539.385821:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.385833:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.385842:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783071539.386133:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000930dbee8 reply state 000000003b96daad transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071539.386143:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783071539.386156:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1783071539.386215:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+9:14368:x1869685665677056:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 498us (678us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783071539.386220:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00010000:00010000:0.0:1783071539.387391:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387403:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387410:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387426:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1783071539.387430:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387438:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387450:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782d98a7000) 00010000:00010000:0.0:1783071539.387454:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783071539.387457:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.387464:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c600/0xd360fc6ce6ec868d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071539.387750:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.387831:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665677312 00000100:00100000:1.0:1783071539.387838:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665677312 00000100:00100000:1.0:1783071539.387877:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1783071539.387885:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+8:14368:x1869685665677312:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1783071539.388064:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+9:14368:x1869685665677312:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 179us (315us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783071539.388071:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1783071539.392206:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.392274:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665677568 00000100:00100000:1.0:1783071539.392282:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665677568 00000100:00100000:1.0:1783071539.392326:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:1.0:1783071539.392337:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+9:14368:x1869685665677568:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.392357:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.392374:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadc3 expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392491:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392502:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392510:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392518:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392522:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.392526:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.393104:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783071539.393201:0:15543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393208:0:15543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393212:0:15543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393216:0:15543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb3400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.393219:0:15543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393224:0:15543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393232:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.393234:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.393236:0:15543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393240:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3400/0xd360fc6ce6ec869b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393248:0:15543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393252:0:15543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393255:0:15543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393265:0:15543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c9fb2c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.393267:0:15543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393270:0:15543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393274:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9782c4fabe00) 00010000:00010000:1.0:1783071539.393275:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.393277:0:15543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393280:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb2c00/0xd360fc6ce6ec86a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393308:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8694 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadc3 expref: 11 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393314:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.393316:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071539.393318:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3000/0xd360fc6ce6ec8694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadc3 expref: 11 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.393323:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c9fb3000, rc 0) 00000100:00100000:1.0:1783071539.393381:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+10:14368:x1869685665677568:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1047us (1183us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1783071539.393389:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1783071539.398007:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.398407:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665677696 00000100:00100000:1.0:1783071539.398443:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665677696 00000100:00100000:1.0:1783071539.398547:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1783071539.398558:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+10:14368:x1869685665677696:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.398585:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.398608:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec86b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadca expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398739:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398753:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398763:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.398812:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783071539.398815:0:14230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071539.398837:0:14230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398863:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c9fb3a00/0xd360fc6ce6ec86b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398882:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.398891:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071539.398894:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783071539.398897:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9600, rc 0) 00000100:00100000:1.0:1783071539.398972:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:571ce320-8198-4e7a-bd6a-735948ba4f6e+11:14368:x1869685665677696:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 415us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.398980:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1783071539.410279:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.410567:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665677824 00000100:00100000:1.0:1783071539.410580:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665677824 00000100:00100000:1.0:1783071539.410795:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1783071539.410806:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+11:14368:x1869685665677824:12345-192.168.202.16@tcp:37:lfs.0 00000100:00100000:1.0:1783071539.415555:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+11:14368:x1869685665677824:12345-192.168.202.16@tcp:37:lfs.0 Request processed in 4740us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.415569:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1783071539.419581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.419770:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678080 00000100:00100000:0.0:1783071539.419779:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678080 00000100:00100000:0.0:1783071539.419831:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1783071539.419840:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49e5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+11:14368:x1869685665678080:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071539.420079:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49e5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+12:14368:x1869685665678080:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 239us (506us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783071539.420086:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000001:00080000:3.0:1783071539.462806:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1783071539.462833:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:0.0:1783071539.486923:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.487010:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678208 00000100:00100000:1.0:1783071539.487018:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678208 00000100:00100000:1.0:1783071539.487077:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:1.0:1783071539.487086:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+8:14374:x1869685665678208:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071539.487103:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.487120:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec86be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadd1 expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487181:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487192:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487200:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487211:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487225:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.487229:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.487889:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938800/0xd360fc6ce6ec86d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.487898:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938800/0xd360fc6ce6ec86d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.487903:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938800/0xd360fc6ce6ec86d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071539.487969:0:15543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783071539.487973:0:15543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783071539.488049:0:15543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938800/0xd360fc6ce6ec86d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488062:0:15543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488069:0:15543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488075:0:15543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488081:0:15543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071539.488084:0:15543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488093:0:15543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488102:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:2.0:1783071539.488104:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071539.488107:0:15543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488112:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8000/0xd360fc6ce6ec86c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488124:0:15543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488131:0:15543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488136:0:15543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488141:0:15543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071539.488143:0:15543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488148:0:15543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488156:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9782c4fabe00) 00010000:00010000:2.0:1783071539.488158:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071539.488160:0:15543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488174:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec86cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488204:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec86be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd1 expref: 10 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488216:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938800/0xd360fc6ce6ec86d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd1 expref: 9 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.488224:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:2.0:1783071539.488226:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783071539.488229:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7938800, rc 0) 00000100:00100000:2.0:1783071539.488330:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14374:x1869685665678208:12345-192.168.202.16@tcp:101:bash.0 Request processed in 1245us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071539.488336:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1783071539.491040:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.491111:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678464 00000100:00100000:0.0:1783071539.491118:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678464 00000100:00100000:0.0:1783071539.491188:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1783071539.491195:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:14374:x1869685665678464:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1783071539.491212:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071539.491225:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec86da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadd8 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.491506:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.491519:0:14229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 6 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.491526:0:14229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.491551:0:14229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 6 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.491565:0:14229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 6 pid: 14230 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071539.491575:0:14229:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1869685684532224:192.168.202.16@tcp:104: 00000100:00100000:0.0:1783071539.491657:0:14229:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783071539.500158:0:14229:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14229:1869685684532224:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071539.500186:0:14229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071539.500815:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.501025:0:16246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678592 00000100:00100000:3.0:1783071539.501033:0:16246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678592 00010000:00010000:3.0:1783071539.501069:0:16246:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 7 pid: 14230 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071539.501109:0:16246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1783071539.501118:0:16246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+7:2357:x1869685665678592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071539.501133:0:16246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071539.501140:0:16246:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 7 pid: 14230 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501152:0:16246:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 7 pid: 14230 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501183:0:16246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec86b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadca expref: 7 pid: 14230 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501198:0:16246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:3.0:1783071539.501203:0:16246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501212:0:16246:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501220:0:16246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.501254:0:16246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071539.501314:0:16246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2357:x1869685665678592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 196us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071539.501321:0:16246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00010000:00010000:1.0:1783071539.501794:0:14229:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.502072:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.502122:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.502146:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.502158:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.506562:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.506654:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.506667:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.507006:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783071539.509944:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.509957:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.509965:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.509970:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.509975:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.509982:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.509998:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071539.510001:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071539.510005:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.510011:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec86e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783071539.510029:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bad22670 reply state 00000000810eb769 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.510038:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783071539.510082:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d400/0xd360fc6ce6ec86da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.510097:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.510113:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.510115:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783071539.510117:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9e00, rc 0) 00000100:00100000:1.0:1783071539.511505:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+12:14374:x1869685665678464:12345-192.168.202.16@tcp:101:bash.0 Request processed in 20301us (20465us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783071539.511516:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00010000:00010000:3.0:1783071539.514850:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514867:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514874:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514880:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071539.514884:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514892:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514908:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9782c4fabb00) 00010000:00010000:3.0:1783071539.514912:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071539.514916:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.514922:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec86e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071539.524599:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.526745:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678720 00000100:00100000:1.0:1783071539.526761:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678720 00000100:00100000:1.0:1783071539.526843:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1783071539.526853:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+11:14374:x1869685665678720:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1783071539.526876:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.526896:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec86fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaddf expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.526960:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.526973:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.526985:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.527024:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783071539.527028:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783071539.527047:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.527074:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.527099:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec86fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 13 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.527117:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.527125:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.527128:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071539.527132:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9c00, rc 0) 00000100:00100000:1.0:1783071539.527201:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+12:14374:x1869685665678720:12345-192.168.202.16@tcp:101:bash.0 Request processed in 349us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.527209:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1783071539.531109:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.531349:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665678976 00000100:00100000:0.0:1783071539.531358:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665678976 00000100:00100000:0.0:1783071539.531604:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1783071539.531616:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+12:14374:x1869685665678976:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1783071539.531977:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+13:14374:x1869685665678976:12345-192.168.202.16@tcp:35:bash.0 Request processed in 362us (876us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783071539.531986:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1783071539.606779:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.606893:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665679232 00000100:00100000:1.0:1783071539.606904:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665679232 00000100:00100000:1.0:1783071539.606968:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1783071539.606981:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+13:14384:x1869685665679232:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.607004:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.607036:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec870b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcade6 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.607138:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783071539.607324:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec870b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcade6 expref: 15 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.607356:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9782c4fab600) 00010000:00010000:1.0:1783071539.607359:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071539.607365:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec870b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcade6 expref: 15 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.607378:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9400, rc 0) 00000100:00100000:1.0:1783071539.607456:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+14:14384:x1869685665679232:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 477us (684us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1783071539.607463:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1783071539.610198:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071539.610315:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665679488 00000100:00100000:2.0:1783071539.610325:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665679488 00000100:00100000:2.0:1783071539.610439:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1783071539.610449:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+14:14384:x1869685665679488:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1783071539.611000:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+15:14384:x1869685665679488:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 551us (808us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783071539.611009:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000040:00080000:0.0:1783071539.618037:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783071539.652780:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.652984:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665679744 00000100:00100000:1.0:1783071539.652995:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665679744 00000100:00100000:1.0:1783071539.653049:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1783071539.653057:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+15:14387:x1869685665679744:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1783071539.653077:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.653092:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8719 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcaded expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.653176:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec8720 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.653190:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec8720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.653202:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec8720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.653213:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783071539.653339:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8719 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaded expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.653353:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec8720 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaded expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.653358:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.653360:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071539.653363:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9800, rc 0) 00000100:00100000:1.0:1783071539.653422:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+17:14387:x1869685665679744:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 356us (640us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1783071539.653429:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1783071539.656210:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.656287:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071539.656372:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665680000 00000100:00100000:2.0:1783071539.656380:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665680000 00000100:00100000:2.0:1783071539.656490:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1783071539.656500:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+17:2356:x1869685665680000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783071539.656516:0:14215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071539.656549:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec8720 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaded expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.656567:0:14215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:2.0:1783071539.656571:0:14215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783071539.656635:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+16:2356:x1869685665680000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 136us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071539.656644:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071539.657237:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665679872 00000100:00100000:1.0:1783071539.657243:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665679872 00000100:00100000:1.0:1783071539.657308:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1783071539.657316:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+16:14387:x1869685665679872:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:1.0:1783071539.657367:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657381:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657391:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657427:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657435:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657459:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657465:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071539.657470:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657478:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657487:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.657490:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783071539.657494:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.657500:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec872e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.657557:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+16:14387:x1869685665679872:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 241us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.657564:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:3.0:1783071539.659527:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.659797:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665680256 00000100:00100000:0.0:1783071539.659805:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665680256 00000100:00100000:0.0:1783071539.659855:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1783071539.659865:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+16:14387:x1869685665680256:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1783071539.660077:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+17:14387:x1869685665680256:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 212us (556us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783071539.660084:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1783071539.851098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.851201:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665680512 00000100:00100000:1.0:1783071539.851211:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665680512 00000100:00100000:1.0:1783071539.851281:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071539.851291:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+17:14418:x1869685665680512:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:1.0:1783071539.851316:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.851337:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec8735 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadf4 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.851802:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec873c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.851816:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.851829:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec873c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783071539.851841:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783071539.852012:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec8735 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadf4 expref: 20 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.852033:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec873c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadf4 expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.852043:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.852046:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783071539.852049:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9600, rc 0) 00000100:00100000:1.0:1783071539.852112:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14418:x1869685665680512:12345-192.168.202.16@tcp:101:cat.0 Request processed in 823us (1023us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1783071539.852121:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:1.0:1783071539.856463:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.856636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.856729:0:16246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665680896 00000100:00100000:3.0:1783071539.856738:0:16246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665680896 00000100:00100000:3.0:1783071539.856803:0:16246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:3.0:1783071539.856813:0:16246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:2358:x1869685665680896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071539.856829:0:16246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071539.856852:0:16246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec873c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadf4 expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.856871:0:16246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:3.0:1783071539.856876:0:16246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071539.856944:0:16246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+18:2358:x1869685665680896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071539.856953:0:16246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1783071539.865315:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665680768 00000100:00100000:0.0:1783071539.865330:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665680768 00000100:00100000:0.0:1783071539.865394:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071539.865405:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+18:14418:x1869685665680768:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:0.0:1783071539.868108:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14418:x1869685665680768:12345-192.168.202.16@tcp:35:cat.0 Request processed in 2698us (11648us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783071539.868121:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1783071539.903203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.903305:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665681152 00000100:00100000:3.0:1783071539.903316:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665681152 00000100:00100000:3.0:1783071539.903441:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1783071539.903452:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14424:x1869685665681152:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1783071539.903476:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071539.903496:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf400/0xd360fc6ce6ec874a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcadfb expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903586:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903601:0:14230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 20 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903611:0:14230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903632:0:14230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903663:0:14230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903707:0:14230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071539.903721:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14230:1869685684532352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1783071539.903921:0:14230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 20 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.903931:0:14230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 20 pid: 14229 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071539.903940:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14230:1869685684532480:192.168.202.16@tcp:104: 00000100:00100000:3.0:1783071539.903966:0:14230:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c31acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783071539.906039:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14230:1869685684532352:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071539.906053:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4295500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14230:1869685684532480:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071539.906088:0:14230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.907027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.907179:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.907265:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665681280 00000100:00100000:0.0:1783071539.907272:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665681280 00010000:00010000:0.0:1783071539.907307:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 21 pid: 14229 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071539.907343:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665681408 00000100:00100000:0.0:1783071539.907347:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665681408 00010000:00010000:0.0:1783071539.907359:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 22 pid: 14228 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071539.907395:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071539.907404:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:2357:x1869685665681280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071539.907427:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071539.907434:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 22 pid: 14229 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907446:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 22 pid: 14229 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907466:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec86ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadd8 expref: 22 pid: 14229 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907482:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071539.907487:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907543:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907550:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071539.907601:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:2357:x1869685665681280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 197us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071539.907622:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071539.907670:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1783071539.907718:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+20:2357:x1869685665681408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783071539.907726:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783071539.907732:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907742:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907756:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9c00/0xd360fc6ce6ec8704 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcaddf expref: 20 pid: 14228 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907765:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071539.907770:0:14214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907778:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907798:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907828:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783071539.907849:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:2357:x1869685665681408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 134us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071539.907857:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00010000:00010000:0.0:1783071539.907950:0:14230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.907958:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783071539.907973:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783071539.908121:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf400/0xd360fc6ce6ec874a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadfb expref: 20 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.908137:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfa00/0xd360fc6ce6ec8751 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcadfb expref: 19 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.908143:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071539.908145:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783071539.908147:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cfa00, rc 0) 00000100:00100000:0.0:1783071539.908178:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14424:x1869685665681152:12345-192.168.202.16@tcp:101:dd.0 Request processed in 4729us (4987us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783071539.908185:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1783071539.912157:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.912261:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665681664 00000100:00100000:1.0:1783071539.912272:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665681664 00000100:00100000:1.0:1783071539.912331:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1783071539.912341:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14424:x1869685665681664:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:1.0:1783071539.912642:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.912659:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.912716:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783071539.912769:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1783071539.912815:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007092f94c reply state 00000000666d3741 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071539.912825:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071539.912906:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:14424:x1869685665681664:12345-192.168.202.16@tcp:36:dd.0 Request processed in 567us (758us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1783071539.912914:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000020:00080000:1.0:1783071539.912919:0:14228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783071539.916513:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916528:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916534:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916540:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071539.916544:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916551:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916581:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:2.0:1783071539.916584:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071539.916588:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071539.916594:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9000/0xd360fc6ce6ec875f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071539.917196:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.917277:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665681792 00000100:00100000:1.0:1783071539.917287:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665681792 00000100:00100000:1.0:1783071539.917343:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:1.0:1783071539.917354:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:14424:x1869685665681792:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1783071539.917386:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071539.917403:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec8766 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae02 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.917471:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec8766 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae02 expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.917484:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec8766 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae02 expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.917503:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071539.917506:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071539.917509:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9a00, rc 0) 00000100:00100000:1.0:1783071539.917641:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:14424:x1869685665681792:12345-192.168.202.16@tcp:101:dd.0 Request processed in 287us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.917648:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:0.0:1783071539.948068:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071539.948159:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682048 00000100:00100000:3.0:1783071539.948170:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682048 00000100:00100000:3.0:1783071539.948237:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1783071539.948248:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:14424:x1869685665682048:12345-192.168.202.16@tcp:103:dd.0 00010000:00010000:3.0:1783071539.948278:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071539.948303:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9a00/0xd360fc6ce6ec8766 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae02 expref: 22 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071539.948322:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:3.0:1783071539.948328:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071539.948390:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:14424:x1869685665682048:12345-192.168.202.16@tcp:103:dd.0 Request processed in 143us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071539.948397:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1783071539.950924:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071539.951736:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682176 00000100:00100000:1.0:1783071539.951747:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682176 00000100:00100000:1.0:1783071539.951813:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1783071539.951824:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:14424:x1869685665682176:12345-192.168.202.16@tcp:58:dd.0 00010000:00010000:1.0:1783071539.951926:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.951942:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071539.951953:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071539.954292:0:14228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783071539.954463:0:14228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1783071539.954541:0:14228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1783071539.955305:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:14424:x1869685665682176:12345-192.168.202.16@tcp:58:dd.0 Request processed in 3478us (4385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071539.955316:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1783071539.958988:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071539.959042:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682304 00000100:00100000:0.0:1783071539.959051:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682304 00000100:00100000:0.0:1783071539.959315:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1783071539.959324:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+21:14424:x1869685665682304:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1783071539.959361:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783071539.959382:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae09 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959449:0:14230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959458:0:14230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 22 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959473:0:14230:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959482:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 22 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959492:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:0.0:1783071539.959494:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783071539.959496:0:14230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 22 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071539.959501:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97830217c000, rc 0) 00000100:00100000:0.0:1783071539.959547:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:14424:x1869685665682304:12345-192.168.202.16@tcp:101:dd.0 Request processed in 224us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071539.959554:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00010000:00010000:0.0:1783071540.257725:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783071540.640963:0:14262:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071540.640973:0:14262:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071540.641181:0:14262:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783071540.641189:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783071540.641303:0:14262:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14262:1869685684532608:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783071540.641472:0:14262:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071540.652932:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.654052:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682432 00000100:00100000:3.0:1783071540.654062:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682432 00000100:00100000:3.0:1783071540.654115:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1783071540.654126:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682432:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783071540.654226:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682432:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 102us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.654234:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071540.656603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.656714:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682560 00000100:00100000:2.0:1783071540.656722:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682560 00000100:00100000:2.0:1783071540.656781:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1783071540.656791:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682560:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071540.656819:0:14228:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071540.656917:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682560:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071540.656924:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:1.0:1783071540.661421:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.661935:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682688 00000100:00100000:3.0:1783071540.661945:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682688 00000100:00100000:3.0:1783071540.662002:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1783071540.662021:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682688:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.662083:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662097:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662125:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662293:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662300:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662305:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662321:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662326:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662330:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071540.662362:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783071540.662364:0:14229:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071540.662373:0:14229:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662382:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662389:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662415:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662422:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071540.662426:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662435:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662445:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782d91c2e00) 00010000:00010000:3.0:1783071540.662448:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071540.662451:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662456:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec877b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662466:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662469:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662473:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662476:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020ce200 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071540.662478:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662488:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662493:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9782d91c2000) 00010000:00010000:3.0:1783071540.662494:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071540.662496:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662499:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec8782 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662510:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662513:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662517:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662519:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cfc00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071540.662521:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662524:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662527:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:3.0:1783071540.662528:0:14229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783071540.662530:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.662549:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec8789 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.663084:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682688:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 1071us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.663093:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:0.0:1783071540.663389:0:14262:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14262:1869685684532608:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783071540.668189:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.668246:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665682944 00000100:00100000:2.0:1783071540.668256:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665682944 00000100:00100000:2.0:1783071540.668353:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:2.0:1783071540.668365:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:14425:x1869685665682944:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783071540.668384:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783071540.668413:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8790 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae10 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668511:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668536:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668544:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783071540.668554:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783071540.668637:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668645:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668652:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668657:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071540.668659:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668664:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668692:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:2.0:1783071540.668696:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783071540.668701:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668707:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8797 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668748:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8790 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae10 expref: 24 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668764:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9782d91c2e00) 00010000:00010000:2.0:1783071540.668767:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783071540.668771:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec8790 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae10 expref: 24 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.668780:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782c7939600, rc 0) 00000100:00100000:2.0:1783071540.668838:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665682944:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 475us (654us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783071540.668845:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1783071540.673114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.673238:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665683072 00000100:00100000:2.0:1783071540.673248:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665683072 00000100:00100000:2.0:1783071540.673303:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1783071540.673312:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665683072:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783071540.673346:0:14230:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783071540.673448:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665683072:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071540.673456:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:1.0:1783071540.683248:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.683340:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665683328 00000100:00100000:3.0:1783071540.683351:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665683328 00000100:00100000:3.0:1783071540.683423:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1783071540.683434:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:14425:x1869685665683328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.683456:0:15543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071540.683475:0:15543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae17 expref: -99 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783071540.684278:0:15543:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1783071540.684285:0:15543:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1783071540.684329:0:15543:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1783071540.684590:0:15543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec87ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.684850:0:15543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec87ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.684861:0:15543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec87ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.684919:0:15543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae17 expref: 26 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.684949:0:15543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec87ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae17 expref: 25 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.684958:0:15543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2000) 00010000:00010000:3.0:1783071540.684961:0:15543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783071540.684964:0:15543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020ce200, rc 0) 00000100:00100000:3.0:1783071540.685470:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+25:14425:x1869685665683328:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2035us (2229us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1783071540.685479:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1783071540.691730:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.691829:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665683584 00000100:00100000:1.0:1783071540.691839:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665683584 00000100:00100000:1.0:1783071540.691902:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1783071540.691913:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+25:14425:x1869685665683584:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071540.691970:0:14230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783071540.691995:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce200/0xd360fc6ce6ec87ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae17 expref: 25 pid: 15543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692023:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2000) 00010000:00010000:1.0:1783071540.692033:0:14230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071540.692053:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692066:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692076:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692105:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692124:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692131:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692203:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692210:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692217:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692223:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.692227:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692235:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692244:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9782c4fab300) 00010000:00010000:1.0:1783071540.692246:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071540.692250:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692256:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9e00/0xd360fc6ce6ec87ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692271:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692277:0:14230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692282:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692287:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.692290:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692295:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692303:0:14230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa0751781 (ffff9782c4fab500) 00010000:00010000:1.0:1783071540.692305:0:14230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071540.692308:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.692314:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9600/0xd360fc6ce6ec87c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0751781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.692412:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+24:14425:x1869685665683584:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 491us (692us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783071540.692420:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1783071540.694535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.694612:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665683712 00000100:00100000:3.0:1783071540.694620:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665683712 00000100:00100000:3.0:1783071540.694704:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1783071540.694714:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+24:14425:x1869685665683712:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.694733:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071540.694754:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec87c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae1e expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694797:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf800/0xd360fc6ce6ec87cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694809:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf800/0xd360fc6ce6ec87cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694819:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf800/0xd360fc6ce6ec87cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694921:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec87c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae1e expref: 26 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694953:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf800/0xd360fc6ce6ec87cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae1e expref: 25 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.694962:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:3.0:1783071540.694965:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783071540.694968:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cf800, rc 0) 00000100:00100000:3.0:1783071540.695025:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+25:14425:x1869685665683712:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 312us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.695032:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1783071540.698925:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.699032:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665683968 00000100:00100000:1.0:1783071540.699052:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665683968 00000100:00100000:1.0:1783071540.699104:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1783071540.699119:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+25:14425:x1869685665683968:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783071540.699196:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.699213:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.699224:0:14230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783071540.700213:0:14230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1783071540.700225:0:14230:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442074550136ns, next at 443074547691ns, rc = 0 00000004:00010000:1.0:1783071540.700315:0:14230:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008885c3c1 reply state 00000000134371c1 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.700325:0:14230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783071540.700437:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+27:14425:x1869685665683968:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1323us (1518us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1783071540.700445:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00010000:00010000:3.0:1783071540.702521:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702537:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702545:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702551:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1783071540.702555:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702562:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702579:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:3.0:1783071540.702594:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783071540.702609:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.702616:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9800/0xd360fc6ce6ec87d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071540.703878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.704200:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684096 00000100:00100000:3.0:1783071540.704210:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684096 00000100:00100000:3.0:1783071540.704266:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:3.0:1783071540.704276:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+26:14425:x1869685665684096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.704299:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071540.704319:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae25 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.704372:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 27 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.704386:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 27 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.704415:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:3.0:1783071540.704418:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783071540.704422:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020cfc00, rc 0) 00000100:00100000:3.0:1783071540.704476:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+27:14425:x1869685665684096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 201us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.704483:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1783071540.707902:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.707997:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684224 00000100:00100000:3.0:1783071540.708004:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684224 00000100:00100000:3.0:1783071540.708070:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1783071540.708077:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2357:x1869685665684224:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783071540.708193:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783071540.708592:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2357:x1869685665684224:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 513us (696us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783071540.708660:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1783071540.710529:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071540.710622:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684480 00000100:00100000:0.0:1783071540.710630:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684480 00000100:00100000:0.0:1783071540.710708:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1783071540.710718:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+27:14425:x1869685665684480:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783071540.710934:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+28:14425:x1869685665684480:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 218us (411us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1783071540.710942:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1783071540.713126:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.713212:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684736 00000100:00100000:3.0:1783071540.713220:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684736 00000100:00100000:3.0:1783071540.713275:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1783071540.713284:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+28:14425:x1869685665684736:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783071540.713522:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+28:14425:x1869685665684736:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 239us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.713531:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:1.0:1783071540.715478:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.715526:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684864 00000100:00100000:3.0:1783071540.715535:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684864 00000100:00100000:3.0:1783071540.715589:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:3.0:1783071540.715598:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+28:14425:x1869685665684864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.715618:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783071540.715638:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec87e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae2c expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715840:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715863:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715871:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783071540.715905:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783071540.715918:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715937:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cf600/0xd360fc6ce6ec87e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae2c expref: 30 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715949:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae2c expref: 29 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.715956:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:3.0:1783071540.715958:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783071540.715960:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9783020ce800, rc 0) 00000100:00100000:3.0:1783071540.716003:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+29:14425:x1869685665684864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 406us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.716010:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1783071540.718485:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.718650:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665684992 00000100:00100000:1.0:1783071540.718658:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665684992 00000100:00100000:1.0:1783071540.718722:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1783071540.718731:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+6:2358:x1869685665684992:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783071540.718747:0:14862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783071540.718767:0:14862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf07d0915bcae33 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783071540.718867:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a478335, blocks: 0x1 00010000:00010000:1.0:1783071540.718884:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1783071540.718888:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071540.718898:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 7 pid: 14862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.718915:0:14862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 7 pid: 14862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.718927:0:14862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9782fa7b9e00, rc 0) 00000100:00100000:1.0:1783071540.719014:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:2358:x1869685665684992:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 283us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.719021:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1783071540.721013:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.721066:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665685248 00000100:00100000:1.0:1783071540.721075:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665685248 00000100:00100000:1.0:1783071540.721124:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1783071540.721133:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+29:14425:x1869685665685248:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783071540.721220:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+29:14425:x1869685665685248:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.721228:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:0.0:1783071540.722576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.722634:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665685376 00000100:00100000:3.0:1783071540.722641:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665685376 00000100:00100000:3.0:1783071540.722709:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1783071540.722914:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+29:14425:x1869685665685376:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783071540.752373:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1783071540.752415:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783071540.752881:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684532736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783071540.752983:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+14:14425:x1869685665685376:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 30068us (30406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.752990:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071540.752993:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1783071540.753578:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684532736 00000100:00100000:1.0:1783071540.753587:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684532736 00000100:00100000:1.0:1783071540.753666:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783071540.753698:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c4295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1869685684532736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783071540.753858:0:14865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783071540.753862:0:14865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783071540.753864:0:14865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783071540.753866:0:14865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783071541 -> 1783071541 00002000:00010000:1.0:1783071540.753868:0:14865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783071540.753913:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c4295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1869685684532736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (921us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783071540.753920:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1783071540.753956:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9782fa786300/2, rc 0, transno 8589934595 00000100:00100000:1.0:1783071540.753962:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1869685684532736:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1783071540.754019:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783071540.760388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.760490:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665685504 00000100:00100000:3.0:1783071540.760499:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665685504 00000100:00100000:1.0:1783071540.760922:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1783071540.760936:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:2358:x1869685665685504:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783071540.761053:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:2358:x1869685665685504:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 119us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.761189:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1783071540.767128:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.768724:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665685760 00000100:00100000:3.0:1783071540.768739:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665685760 00000100:00100000:2.0:1783071540.769131:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1783071540.769143:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+14:14425:x1869685665685760:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783071540.769206:0:14229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783071540.769233:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020ce800/0xd360fc6ce6ec87eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae2c expref: 14 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.769254:0:14229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:2.0:1783071540.769259:0:14229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783071540.769288:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.769302:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.769310:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783071540.769508:0:14229:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ac9ee7d reply state 000000007dd0a411 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071540.769518:0:14229:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783071540.769988:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+15:14425:x1869685665685760:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 846us (2869us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783071540.769996:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00010000:00010000:2.0:1783071540.771757:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771771:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771789:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771812:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1783071540.771817:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771825:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771841:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:2.0:1783071540.771843:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783071540.771848:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.771853:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939c00/0xd360fc6ce6ec87f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071540.773314:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.773390:0:15760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665685888 00000100:00100000:3.0:1783071540.773399:0:15760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665685888 00000100:00100000:3.0:1783071540.773468:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1783071540.773479:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:2357:x1869685665685888:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783071540.773697:0:15760:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783071540.773700:0:15760:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783071540 00002000:00010000:3.0:1783071540.773702:0:15760:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783071540 00002000:00010000:3.0:1783071540.773704:0:15760:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783071541 -> 1783071540 00002000:00010000:3.0:1783071540.773706:0:15760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783071540.773771:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+8:2357:x1869685665685888:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 294us (463us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783071540.773789:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071540.776365:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.776547:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686016 00000100:00100000:3.0:1783071540.776555:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686016 00000100:00100000:3.0:1783071540.776628:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1783071540.776637:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+8:2357:x1869685665686016:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783071540.776799:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776817:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.776822:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.776828:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776842:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776889:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776897:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776906:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776914:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9783020cf600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071540.776918:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776928:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776943:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.776952:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fa23d6/0xd360fc6ce6ec8800 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.777293:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+8:2357:x1869685665686016:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 656us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.777312:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1783071540.779976:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.780132:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686272 00000100:00100000:2.0:1783071540.780143:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686272 00000100:00100000:2.0:1783071540.780238:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1783071540.780248:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+14:14425:x1869685665686272:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783071540.780327:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780345:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780357:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780643:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780663:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780911:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780946:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 15 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.780960:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 15 pid: 14228 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071540.780973:0:14228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684532864:192.168.202.16@tcp:104: 00000100:00100000:2.0:1783071540.781164:0:14228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c5dd6780 going to sleep for 11 seconds 00000100:00100000:2.0:1783071540.784546:0:14228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa785180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684532864:192.168.202.16@tcp:104: 00010000:00010000:2.0:1783071540.784589:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071540.786472:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.786553:0:16246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686400 00000100:00100000:3.0:1783071540.786563:0:16246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686400 00010000:00010000:3.0:1783071540.786610:0:16246:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 16 pid: 14228 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.786643:0:16246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:3.0:1783071540.786653:0:16246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+16:2356:x1869685665686400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071540.786666:0:16246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071540.786699:0:16246:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 16 pid: 14228 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786713:0:16246:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 16 pid: 14228 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786737:0:16246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9783020cfc00/0xd360fc6ce6ec87dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae25 expref: 16 pid: 14228 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786757:0:16246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:3.0:1783071540.786762:0:16246:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786772:0:16246:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786790:0:16246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.786833:0:16246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783071540.786881:0:16246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+15:2356:x1869685665686400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 228us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.786889:0:16246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:0.0:1783071540.787169:0:14228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.787192:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071540.787389:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1783071540.787557:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1783071540.787621:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1783071540.787741:0:14228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1869685684532992:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783071540.788138:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071540.788172:0:14228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4a65300 going to sleep for 11 seconds 00000100:00100000:2.0:1783071540.788312:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684532992 00000100:00100000:2.0:1783071540.788318:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684532992 00000100:00100000:2.0:1783071540.788355:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783071540.788363:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14228:x1869685684532992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783071540.788450:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14228:x1869685684532992:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071540.788457:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783071540.788727:0:14228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1869685684532992:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783071540.792910:0:14228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1783071540.793182:0:14228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1869685684533120:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783071540.793250:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071540.793328:0:14228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782f9c7bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783071540.793369:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684533120 00000100:00100000:2.0:1783071540.793452:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684533120 00000100:00100000:2.0:1783071540.793538:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783071540.793548:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14228:x1869685684533120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783071540.794049:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14228:x1869685684533120:12345-0@lo:1000:mdt00_000.0 Request processed in 501us (797us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783071540.794057:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783071540.794299:0:14228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782faf2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14228:1869685684533120:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783071540.794339:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794349:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794357:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794663:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.794669:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794901:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794917:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00010000:00010000:1.0:1783071540.794920:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071540.794925:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794930:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7939600/0xd360fc6ce6ec880e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794963:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794969:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794977:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794982:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.794985:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.794991:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.795081:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071540.795084:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783071540.795090:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.795101:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.795110:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.795140:0:14228:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97830217c000/0xd360fc6ce6ec8774 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae09 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.795153:0:14228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684533248:192.168.202.16@tcp:105: 00000100:00100000:1.0:1783071540.795270:0:14228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4ae3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071540.800319:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.800413:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686528 00000100:00100000:2.0:1783071540.800424:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686528 00000100:00100000:2.0:1783071540.800484:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1783071540.800495:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c49e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14424:x1869685665686528:12345-192.168.202.16@tcp:49:dd.0 00000100:00100000:2.0:1783071540.800863:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c49e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+19:14424:x1869685665686528:12345-192.168.202.16@tcp:49:dd.0 Request processed in 369us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071540.800871:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1783071540.804908:0:14228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14228:1869685684533248:192.168.202.16@tcp:105: 00010000:00010000:1.0:1783071540.804942:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.804954:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b8400/0xd360fc6ce6ec876d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.804993:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805077:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805104:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805115:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805121:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805127:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805132:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.805136:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805143:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805154:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071540.805157:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783071540.805160:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805166:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782fa7b9400/0xd360fc6ce6ec8815 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805175:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805181:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805193:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805199:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1783071540.805202:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805209:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805217:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9782c4fabc00) 00010000:00010000:1.0:1783071540.805219:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783071540.805222:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.805228:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9782c7938000/0xd360fc6ce6ec8807 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.805536:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+18:14425:x1869685665686272:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 25287us (25564us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783071540.805547:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000020:00080000:1.0:1783071540.805554:0:14228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783071540.808901:0:14262:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783071540.808909:0:14262:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783071540.809276:0:14262:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783071540.809284:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783071540.813348:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071540.813421:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686784 00000100:00100000:0.0:1783071540.813434:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686784 00000100:00100000:0.0:1783071540.813558:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1783071540.813570:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+18:14425:x1869685665686784:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783071540.814311:0:14231:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783071540.814438:0:14231:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1783071540.814479:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814503:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814515:0:14231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814525:0:14231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814532:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814538:0:14231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.814567:0:14231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783071540.814609:0:14217:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783071540.814618:0:14217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.814626:0:14217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071540.814631:0:14217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.814645:0:14217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.814659:0:14217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9782d91c2800) 00000100:00100000:0.0:1783071540.814662:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+20:14425:x1869685665686784:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 1091us (1326us total) trans 8589934622 rc 0/0 00010000:00010000:1.0:1783071540.814663:0:14217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783071540.814669:0:14217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.814700:0:14217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97830217d200/0xd360fc6ce6ec881c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071540.814700:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000020:00080000:0.0:1783071540.814709:0:14231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783071540.814720:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071540.814723:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783071540.814727:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783071540.916573:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.916747:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665686912 00000100:00100000:1.0:1783071540.916757:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665686912 00000100:00100000:1.0:1783071540.916838:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071540.916848:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+8:2358:x1869685665686912:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1783071540.916881:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.916900:0:14868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 8 pid: 14862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.916907:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071540.916910:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071540.916913:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.916957:0:14868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 8 pid: 14862 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.916966:0:14868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 8 pid: 14862 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.916977:0:14868:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782c824e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:14868:1869685684533376:192.168.202.16@tcp:104: 00000100:00100000:1.0:1783071540.917053:0:14868:0:(client.c:2701:ptlrpc_set_wait()) set ffff9782c4ae3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783071540.919497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.919722:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783071540.919732:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1783071540.920418:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687040 00000100:00100000:0.0:1783071540.920428:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687040 00000100:00100000:2.0:1783071540.921497:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:2.0:1783071540.921511:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:2357:x1869685665687040:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1783071540.921547:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.921830:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.921836:0:16359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.921841:0:16359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.921851:0:16359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783071540.924517:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.924598:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.924727:0:14868:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782c824e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:14868:1869685684533376:192.168.202.16@tcp:104: 00010000:00010000:1.0:1783071540.924764:0:14868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.924979:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687424 00000100:00100000:3.0:1783071540.924987:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687424 00010000:00010000:3.0:1783071540.925032:0:14214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 10 pid: 14862 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.925068:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1783071540.925078:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+10:2357:x1869685665687424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783071540.925091:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783071540.925112:0:14214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 10 pid: 14862 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925123:0:14214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 10 pid: 14862 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925146:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38b2e21/0xd360fc6ce6ec87f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xbf07d0915bcae33 expref: 10 pid: 14862 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925162:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.925166:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.925172:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925199:0:14214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925209:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.925212:0:14214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783071540.925216:0:14214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925223:0:14214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071540.925256:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783071540.925424:0:14868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071540.925434:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.926606:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8584ea24-866d-47dd-88c5-ae90837cb4cb+9:2357:x1869685665687424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1524us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071540.926616:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1783071540.926840:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783071540.926848:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1783071540.926953:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687168 00000100:00100000:0.0:1783071540.926959:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687168 00010000:00010000:2.0:1783071540.927919:0:16359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.927930:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071540.928708:0:16360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:0.0:1783071540.928721:0:16360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8584ea24-866d-47dd-88c5-ae90837cb4cb+11:2358:x1869685665687168:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1783071540.928751:0:16360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.928770:0:16360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071540.928774:0:16360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071540.928781:0:16360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071540.928793:0:16360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071540.930651:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.930761:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1783071540.930872:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1783071540.930957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1783071540.930993:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1783071540.931363:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1783071540.931736:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687296 00000100:00100000:0.0:1783071540.931744:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687296 00000100:00100000:0.0:1783071540.931791:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1783071540.931799:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687552 00000100:00100000:0.0:1783071540.931804:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687552 00000100:00100000:1.0:1783071540.931980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071540.932000:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1783071540.933018:0:16361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687808 00000100:00100000:2.0:1783071540.933027:0:16361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687808 00000100:00100000:2.0:1783071540.933056:0:16361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687680 00000100:00100000:2.0:1783071540.933059:0:16361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687680 00000100:00100000:2.0:1783071540.933070:0:16361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665687936 00000100:00100000:2.0:1783071540.933072:0:16361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665687936 00000100:00100000:2.0:1783071540.933083:0:16361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1783071540.933089:0:16361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8584ea24-866d-47dd-88c5-ae90837cb4cb+17:2358:x1869685665687296:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1783071540.933120:0:16361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.933134:0:16361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.933137:0:16361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.933143:0:16361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.933152:0:16361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783071540.937913:0:14869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:2.0:1783071540.940184:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1783071540.940203:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8584ea24-866d-47dd-88c5-ae90837cb4cb+18:2358:x1869685665687552:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1783071540.940243:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.940260:0:16362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.940265:0:16362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783071540.940272:0:16362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783071540.940286:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071540.960867:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783071540.960891:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c4294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684533504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783071540.960962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783071540.961083:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684533504 00000100:00100000:3.0:1783071540.961091:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684533504 00000100:00100000:0.0:1783071540.963035:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071540.963054:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c51c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684533632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783071540.963240:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071540.963304:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684533632 00000100:00100000:0.0:1783071540.963311:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684533632 00000100:00100000:3.0:1783071540.963342:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783071540.963359:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684533504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783071540.963383:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69795840 pending 8519680 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783071540.963437:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1869685684533504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2475us total) trans 0 rc 0/0 00000100:00080000:0.0:1783071540.963567:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783071540.963606:0:3295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c4294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1869685684533504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783071540.973234:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783071540.973279:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684534016:0@lo:400:kworker.0 00000100:00100000:0.0:1783071540.973343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783071540.973387:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783071540.973395:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782f9d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684534144:0@lo:400:kworker.0 00000100:00100000:0.0:1783071540.973442:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783071540.974750:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783071540.974821:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684533632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783071540.974859:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783071540.974948:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9782fa787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684533760:0@lo:400:kworker.0 00000100:00100000:2.0:1783071540.975118:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869685684533632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 356us (11877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071540.975126:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783071540.976149:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071540.976192:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783071540.976202:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684533888:0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.976233:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783071540.979326:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684533760 00000100:00100000:1.0:1783071540.979339:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684533760 00000100:00100000:1.0:1783071540.979390:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783071540.979412:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3292:x1869685684533760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.979486:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec+19:3292:x1869685684533760:12345-0@lo:400:kworker.0 Request processed in 87us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.979493:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783071540.979941:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c51c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1869685684533632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783071540.980447:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684534016 00000100:00100000:1.0:1783071540.980936:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684534144 00000100:00100000:1.0:1783071540.980943:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684534144 00000100:00100000:1.0:1783071540.980987:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685684533888 00000100:00100000:1.0:1783071540.980990:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684533888 00000100:00080000:0.0:1783071540.981044:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783071540.982121:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071540.982134:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684534144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.982222:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869685684534144:12345-0@lo:400:kworker.0 Request processed in 92us (8779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.982229:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783071540.982245:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071540.982251:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684533888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.982281:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869685684533888:12345-0@lo:400:kworker.0 Request processed in 31us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071540.982287:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783071540.982338:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1869685684534144:0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.982395:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9781c727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869685684533888:0@lo:400:kworker.0 00000100:00100000:1.0:1783071540.982421:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782fa787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96ce0e42-aa84-4f8d-9a9f-77c6b4147dec:3292:1869685684533760:0@lo:400:kworker.0 00000100:00100000:3.0:1783071540.984311:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685684534016 00000100:00100000:0.0:1783071540.987786:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783071540.987799:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684534016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783071540.987891:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c51c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869685684534016:12345-0@lo:400:kworker.0 Request processed in 95us (14549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071540.987900:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1783071540.987924:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071540.987965:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9782f9d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1869685684534016:0@lo:400:kworker.0 00002000:00010000:1.0:1783071541.034913:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:1.0:1783071541.034920:0:14868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783071540 -> 1783071541 00002000:00010000:1.0:1783071541.034922:0:14868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783071540 -> 1783071541 00002000:00010000:1.0:1783071541.034923:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1783071541.034935:0:14868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034944:0:14868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034950:0:14868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034954:0:14868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071541.034957:0:14868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034965:0:14868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034986:0:14868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.034993:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134df1a1/0xd360fc6ce6ec8823 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.035083:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+28:2358:x1869685665686912:12345-192.168.202.16@tcp:4:dd.0 Request processed in 118231us (118515us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783071541.035093:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1783071541.035124:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1783071541.035136:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+27:2357:x1869685665687808:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1783071541.035180:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.035191:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071541.035195:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071541.035201:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.035213:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783071541.038746:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1783071541.038762:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1783071541.038767:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1783071541.078020:0:16361:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1783071541.078029:0:16361:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 10247 00010000:00010000:0.0:1783071541.078044:0:16361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078058:0:16361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078067:0:16361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078073:0:16361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7939400 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071541.078079:0:16361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078104:0:16361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078128:0:16361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.078136:0:16361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba68d04/0xd360fc6ce6ec8838 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078252:0:16360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078262:0:16360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078269:0:16360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078288:0:16360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217c600 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071541.078292:0:16360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078299:0:16360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078310:0:16360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078317:0:16360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b365bb1/0xd360fc6ce6ec8831 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.078490:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.078491:0:16360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8584ea24-866d-47dd-88c5-ae90837cb4cb+24:2358:x1869685665687168:12345-192.168.202.16@tcp:4:dd.0 Request processed in 149768us (153976us total) trans 8589934600 rc 0/0 00010000:00010000:3.0:1783071541.078508:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.078512:0:16360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00010000:00010000:3.0:1783071541.078521:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.078525:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938a00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:3.0:1783071541.078528:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.078533:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.078542:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783071541.078547:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad788723/0xd360fc6ce6ec882a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.078551:0:16360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1783071541.078568:0:16360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:2357:x1869685665687680:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1783071541.078614:0:16360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078627:0:16360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071541.078632:0:16360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783071541.078638:0:16360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.078664:0:16360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071541.078966:0:16361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8584ea24-866d-47dd-88c5-ae90837cb4cb+23:2358:x1869685665687296:12345-192.168.202.16@tcp:4:dd.0 Request processed in 145874us (148320us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783071541.078975:0:16361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1783071541.078994:0:16361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1783071541.079002:0:16361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:2357:x1869685665687936:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1783071541.079019:0:16361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079028:0:16361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071541.079031:0:16361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783071541.079036:0:16361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079045:0:16361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079367:0:16362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079377:0:16362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079385:0:16362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079392:0:16362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782c7938e00 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:0.0:1783071541.079395:0:16362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079414:0:16362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079427:0:16362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783071541.079435:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c873b37c/0xd360fc6ce6ec883f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783071541.079470:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8584ea24-866d-47dd-88c5-ae90837cb4cb+22:2358:x1869685665687552:12345-192.168.202.16@tcp:4:dd.0 Request processed in 139272us (148708us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1783071541.079477:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000001:00080000:0.0:1783071541.079513:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:0.0:1783071541.079529:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000100:00100000:3.0:1783071541.085160:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8584ea24-866d-47dd-88c5-ae90837cb4cb+13:2357:x1869685665687040:12345-192.168.202.16@tcp:4:dd.0 Request processed in 163639us (165658us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783071541.085175:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000001:00080000:0.0:1783071541.127389:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1783071541.127719:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1783071541.127725:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1783071541.127739:0:14868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127751:0:14868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127760:0:14868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127767:0:14868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b8000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071541.127845:0:14868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127852:0:14868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127869:0:14868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.127873:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad2e33b1/0xd360fc6ce6ec8846 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.127954:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8584ea24-866d-47dd-88c5-ae90837cb4cb+13:2357:x1869685665687808:12345-192.168.202.16@tcp:4:dd.0 Request processed in 92819us (196994us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783071541.127961:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000001:00080000:0.0:1783071541.163524:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:0.0:1783071541.163558:0:7495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1783071541.163828:0:16360:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1783071541.163857:0:16360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163870:0:16360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163879:0:16360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163887:0:16360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9782fa7b9000 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071541.163892:0:16360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163904:0:16360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163923:0:16360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.163930:0:16360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b3784e/0xd360fc6ce6ec884d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.164348:0:16360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8584ea24-866d-47dd-88c5-ae90837cb4cb+7:2357:x1869685665687680:12345-192.168.202.16@tcp:4:dd.0 Request processed in 85781us (232363us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783071541.164359:0:16360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00010000:00010000:1.0:1783071541.164719:0:16361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164726:0:16361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164732:0:16361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164736:0:16361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97830217d200 already unused, calling callback (ffffffffc16cbce0) 00010000:00010000:1.0:1783071541.164738:0:16361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164742:0:16361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164750:0:16361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783071541.164754:0:16361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c42ee935/0xd360fc6ce6ec8854 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783071541.164803:0:16361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2357:x1869685665687936:12345-192.168.202.16@tcp:4:dd.0 Request processed in 85801us (232801us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1783071541.164809:0:16361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00010000:00010000:0.0:1783071541.282717:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783071541.698265:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698311:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698342:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698374:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698419:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698479:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1783071541.698511:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688192 00000100:00100000:1.0:1783071541.698521:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688192 00000100:00100000:1.0:1783071541.698580:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688448 00000100:00100000:1.0:1783071541.698583:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688448 00000100:00100000:1.0:1783071541.698623:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1783071541.698632:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+20:2355:x1869685665688192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071541.698782:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688064 00000100:00100000:0.0:1783071541.698786:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688064 00000100:00100000:0.0:1783071541.698814:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:0.0:1783071541.698821:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782faef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:2355:x1869685665688064:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1783071541.699034:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688320 00000100:00100000:2.0:1783071541.699038:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688320 00000100:00100000:2.0:1783071541.699071:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688576 00000100:00100000:2.0:1783071541.699074:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688576 00000100:00100000:2.0:1783071541.699102:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869685665688704 00000100:00100000:2.0:1783071541.699105:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869685665688704 00000100:00100000:2.0:1783071541.699119:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1783071541.699125:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2355:x1869685665688320:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1783071541.699311:0:15760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1783071541.699320:0:15760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2355:x1869685665688576:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071541.702116:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782faef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:596f4f5f-d33b-45b3-bf34-e08a5b83c5e6+13:2355:x1869685665688064:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 3280us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071541.702132:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:0.0:1783071541.702230:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1783071541.702246:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2355:x1869685665688448:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071541.702322:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9781c727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:571ce320-8198-4e7a-bd6a-735948ba4f6e+6:2355:x1869685665688448:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 82us (3902us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071541.702328:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:0.0:1783071541.702382:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783071541.702405:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783071541.702409:0:14224:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783071541.702448:0:14864:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783071541.702460:0:14864:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1783071541.702484:0:14862:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783071541.702495:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1783071541.702504:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9782c6620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2355:x1869685665688704:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1783071541.702535:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c6620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2355:x1869685665688704:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 33us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783071541.702561:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1783071541.705911:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782fa787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+20:2355:x1869685665688192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 7270us (7526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783071541.705925:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1783071541.707145:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8584ea24-866d-47dd-88c5-ae90837cb4cb+5:2355:x1869685665688320:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 8014us (8827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783071541.707156:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1783071541.708166:0:15760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9782c824dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:571ce320-8198-4e7a-bd6a-735948ba4f6e+5:2355:x1869685665688576:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 8066us (9042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783071541.708180:0:15760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00010000:00010000:1.0:1783071542.309405:0:14217:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783071542.533847:0:16402:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1783071542.881315:0:14262:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783071542.881326:0:14262:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783071542.881362:0:14262:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783071542.882181:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783071543.330081:0:14216:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28225 lines, 28225 kept, 0 dropped, 0 bad.